2026-03-30 09:00:03 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 09:00:03 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 09:00:03 [auto1.it] INFO: Batch mode enabled: batch 1/2
2026-03-30 09:00:03 [auto1.it] INFO: Starting spider auto1.it
2026-03-30 09:00:03 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 09:00:03 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 09:00:03 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 09:00:03 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 09:00:03 [scrapy.extensions.telnet] INFO: Telnet Password: d943c855bb197438
2026-03-30 09:00:03 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 09:00:03 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_24_2026-03-30T09_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 09:00:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 09:00:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 09:00:03 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 09:00:03 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 09:00:03 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 09:00:03 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 09:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 09:00:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-30 09:00:03 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 09:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 09:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:03 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 09:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 09:00:04 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 09:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 09:00:04 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 09:00:04 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 09:00:04 [scrapy.core.engine] INFO: Spider opened
2026-03-30 09:00:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 09:00:04 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 09:00:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-30 09:00:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 09:00:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 09:00:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 09:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 09:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 09:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 09:00:14 [auto1.it] INFO: Channel: 24h | Page: 0 | totalHits: 3283 | hits on page: 40
2026-03-30 09:00:14 [auto1.it] INFO: Found listing with ID: UM30901
2026-03-30 09:00:14 [auto1.it] INFO: Found listing with ID: KS72345
2026-03-30 09:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS72345%27 HTTP/1.1" 200 None
2026-03-30 09:00:14 [auto1.it] INFO: Scrape type for KS72345: 1
2026-03-30 09:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:14 [auto1.it] INFO: Found listing with ID: DR56605
2026-03-30 09:00:14 [auto1.it] INFO: Found listing with ID: EG14911
2026-03-30 09:00:14 [auto1.it] INFO: Found listing with ID: SE55606
2026-03-30 09:00:14 [auto1.it] INFO: Found listing with ID: TP54883
2026-03-30 09:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP54883%27 HTTP/1.1" 200 None
2026-03-30 09:00:14 [auto1.it] INFO: Scrape type for TP54883: 1
2026-03-30 09:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:14 [auto1.it] INFO: Found listing with ID: UH51209
2026-03-30 09:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH51209%27 HTTP/1.1" 200 None
2026-03-30 09:00:14 [auto1.it] INFO: Scrape type for UH51209: 2
2026-03-30 09:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2cc8b0e-6741-54c9-9e46-fc26293f0f55 with identifier: UH51209
2026-03-30 09:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2cc8b0e-6741-54c9-9e46-fc26293f0f55 with scrape type 2
2026-03-30 09:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2cc8b0e-6741-54c9-9e46-fc26293f0f55 with scrape type 2
2026-03-30 09:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b2cc8b0e-6741-54c9-9e46-fc26293f0f55, identifier: UH51209
2026-03-30 09:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b2cc8b0e-6741-54c9-9e46-fc26293f0f55 with identifier: UH51209
2026-03-30 09:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:00:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 09:00:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:00:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 09:00:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b2cc8b0e-6741-54c9-9e46-fc26293f0f55 with identifier: UH51209
2026-03-30 09:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b2cc8b0e-6741-54c9-9e46-fc26293f0f55 with identifier: UH51209 to the API
2026-03-30 09:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:04:57Z',
 'fuel_type': 'diesel',
 'id': 'b2cc8b0e-6741-54c9-9e46-fc26293f0f55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH51209',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 203919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-24',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Admired',
 'transmission': 'manual',
 'trim': 'Admired',
 'year': 2013}
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH51209%27 HTTP/1.1" 200 None
2026-03-30 09:00:16 [auto1.it] INFO: Saving data for UH51209: {'auction_closing_time': 1774969497.0, 'created_time': 1774440088.192534, 'last_price_update_time': 1774861216.067777}
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UH51209') HTTP/1.1" 204 0
2026-03-30 09:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:16 [auto1.it] INFO: Found listing with ID: WL93075
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL93075%27 HTTP/1.1" 200 None
2026-03-30 09:00:16 [auto1.it] INFO: Scrape type for WL93075: 1
2026-03-30 09:00:16 [auto1.it] INFO: Found listing with ID: LU79948
2026-03-30 09:00:16 [auto1.it] INFO: Found listing with ID: JN50634
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN50634%27 HTTP/1.1" 200 None
2026-03-30 09:00:16 [auto1.it] INFO: Scrape type for JN50634: 1
2026-03-30 09:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:16 [auto1.it] INFO: Found listing with ID: XN71458
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN71458%27 HTTP/1.1" 200 None
2026-03-30 09:00:16 [auto1.it] INFO: Scrape type for XN71458: 1
2026-03-30 09:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:16 [auto1.it] INFO: Found listing with ID: AX59226
2026-03-30 09:00:16 [auto1.it] INFO: Found listing with ID: BS95687
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS95687%27 HTTP/1.1" 200 None
2026-03-30 09:00:16 [auto1.it] INFO: Scrape type for BS95687: 0
2026-03-30 09:00:16 [auto1.it] INFO: Found listing with ID: PE32711
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE32711%27 HTTP/1.1" 200 None
2026-03-30 09:00:16 [auto1.it] INFO: Scrape type for PE32711: 1
2026-03-30 09:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:16 [auto1.it] INFO: Found listing with ID: LR70386
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR70386%27 HTTP/1.1" 200 None
2026-03-30 09:00:16 [auto1.it] INFO: Scrape type for LR70386: 1
2026-03-30 09:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:16 [auto1.it] INFO: Found listing with ID: XY37684
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY37684%27 HTTP/1.1" 200 None
2026-03-30 09:00:16 [auto1.it] INFO: Scrape type for XY37684: 1
2026-03-30 09:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:16 [auto1.it] INFO: Found listing with ID: NA99278
2026-03-30 09:00:16 [auto1.it] INFO: Found listing with ID: FD34465
2026-03-30 09:00:16 [auto1.it] INFO: Found listing with ID: TT47186
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT47186%27 HTTP/1.1" 200 None
2026-03-30 09:00:16 [auto1.it] INFO: Scrape type for TT47186: 2
2026-03-30 09:00:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db16752a-65e2-5b14-a128-188111a3ddf7 with identifier: TT47186
2026-03-30 09:00:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db16752a-65e2-5b14-a128-188111a3ddf7 with scrape type 2
2026-03-30 09:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db16752a-65e2-5b14-a128-188111a3ddf7 with scrape type 2
2026-03-30 09:00:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: db16752a-65e2-5b14-a128-188111a3ddf7, identifier: TT47186
2026-03-30 09:00:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: db16752a-65e2-5b14-a128-188111a3ddf7 with identifier: TT47186
2026-03-30 09:00:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: db16752a-65e2-5b14-a128-188111a3ddf7 with identifier: TT47186
2026-03-30 09:00:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: db16752a-65e2-5b14-a128-188111a3ddf7 with identifier: TT47186 to the API
2026-03-30 09:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:54:19Z',
 'fuel_type': 'diesel',
 'id': 'db16752a-65e2-5b14-a128-188111a3ddf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT47186',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 94486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 30 L1H2 Start&Stop',
 'transmission': 'manual',
 'trim': '30 L1H2 Start&Stop',
 'year': 2022}
2026-03-30 09:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT47186%27 HTTP/1.1" 200 None
2026-03-30 09:00:17 [auto1.it] INFO: Saving data for TT47186: {'auction_closing_time': 1774972459.0, 'created_time': 1774472544.587361, 'last_price_update_time': 1774861217.619486}
2026-03-30 09:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TT47186') HTTP/1.1" 204 0
2026-03-30 09:00:17 [auto1.it] INFO: Found listing with ID: RX48220
2026-03-30 09:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX48220%27 HTTP/1.1" 200 None
2026-03-30 09:00:17 [auto1.it] INFO: Scrape type for RX48220: 1
2026-03-30 09:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS72345/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:17 [auto1.it] INFO: Found listing with ID: TF73958
2026-03-30 09:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF73958%27 HTTP/1.1" 200 None
2026-03-30 09:00:17 [auto1.it] INFO: Scrape type for TF73958: 2
2026-03-30 09:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f772fb5-7db4-5a86-aa0e-1e80652d59f7 with identifier: TF73958
2026-03-30 09:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f772fb5-7db4-5a86-aa0e-1e80652d59f7 with scrape type 2
2026-03-30 09:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f772fb5-7db4-5a86-aa0e-1e80652d59f7 with scrape type 2
2026-03-30 09:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f772fb5-7db4-5a86-aa0e-1e80652d59f7, identifier: TF73958
2026-03-30 09:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f772fb5-7db4-5a86-aa0e-1e80652d59f7 with identifier: TF73958
2026-03-30 09:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:00:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 09:00:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:00:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 09:00:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f772fb5-7db4-5a86-aa0e-1e80652d59f7 with identifier: TF73958
2026-03-30 09:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f772fb5-7db4-5a86-aa0e-1e80652d59f7 with identifier: TF73958 to the API
2026-03-30 09:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-31T15:20:06Z',
 'fuel_type': 'hybrid',
 'id': '0f772fb5-7db4-5a86-aa0e-1e80652d59f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF73958',
 'listing': 'auction',
 'make': 'Lynk & Co',
 'model': '01',
 'odometer': 155634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seller_name': None,
 'title': 'Lynk & Co 01 1.5 Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF73958%27 HTTP/1.1" 200 None
2026-03-30 09:00:19 [auto1.it] INFO: Saving data for TF73958: {'auction_closing_time': 1774970406.0, 'created_time': 1774353810.608385, 'last_price_update_time': 1774861219.061867}
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TF73958') HTTP/1.1" 204 0
2026-03-30 09:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:19 [auto1.it] INFO: Found listing with ID: TM12989
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM12989%27 HTTP/1.1" 200 None
2026-03-30 09:00:19 [auto1.it] INFO: Scrape type for TM12989: 1
2026-03-30 09:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP54883/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:19 [auto1.it] INFO: Channel: 24h | Page: 1 | totalHits: 3283 | hits on page: 40
2026-03-30 09:00:19 [auto1.it] INFO: Found listing with ID: DH32592
2026-03-30 09:00:19 [auto1.it] INFO: Found listing with ID: RD99785
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD99785%27 HTTP/1.1" 200 None
2026-03-30 09:00:19 [auto1.it] INFO: Scrape type for RD99785: 2
2026-03-30 09:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0593d2ef-c338-5afe-ac89-77ccffa22672 with identifier: RD99785
2026-03-30 09:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0593d2ef-c338-5afe-ac89-77ccffa22672 with scrape type 2
2026-03-30 09:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0593d2ef-c338-5afe-ac89-77ccffa22672 with scrape type 2
2026-03-30 09:00:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0593d2ef-c338-5afe-ac89-77ccffa22672, identifier: RD99785
2026-03-30 09:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0593d2ef-c338-5afe-ac89-77ccffa22672 with identifier: RD99785
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 09:00:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 09:00:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0593d2ef-c338-5afe-ac89-77ccffa22672 with identifier: RD99785
2026-03-30 09:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0593d2ef-c338-5afe-ac89-77ccffa22672 with identifier: RD99785 to the API
2026-03-30 09:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:43:32Z',
 'fuel_type': 'petrol',
 'id': '0593d2ef-c338-5afe-ac89-77ccffa22672',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD99785',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 94471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-17',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2020}
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD99785%27 HTTP/1.1" 200 None
2026-03-30 09:00:20 [auto1.it] INFO: Saving data for RD99785: {'auction_closing_time': 1774971812.0, 'created_time': 1774386525.473549, 'last_price_update_time': 1774861220.557349}
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RD99785') HTTP/1.1" 204 0
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: UM30901
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: KS72345
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: ER70142
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER70142%27 HTTP/1.1" 200 None
2026-03-30 09:00:20 [auto1.it] INFO: Scrape type for ER70142: 1
2026-03-30 09:00:20 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/KS72345/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: DR56605
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: EG14911
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: SE55606
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: TP54883
2026-03-30 09:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR70386/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: XW57300
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: AR14989
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: XY74656
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY74656%27 HTTP/1.1" 200 None
2026-03-30 09:00:20 [auto1.it] INFO: Scrape type for XY74656: 1
2026-03-30 09:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL93075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XN71458/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN50634/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE32711/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: UH51209
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH51209%27 HTTP/1.1" 200 None
2026-03-30 09:00:20 [auto1.it] INFO: Scrape type for UH51209: 0
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: WL93075
2026-03-30 09:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: XF75948
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: BJ45035
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: XU90794
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU90794%27 HTTP/1.1" 200 None
2026-03-30 09:00:20 [auto1.it] INFO: Scrape type for XU90794: 1
2026-03-30 09:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: LU79948
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: JN50634
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: XZ58879
2026-03-30 09:00:20 [auto1.it] INFO: Found listing with ID: PM75011
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM75011%27 HTTP/1.1" 200 None
2026-03-30 09:00:20 [auto1.it] INFO: Scrape type for PM75011: 2
2026-03-30 09:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4966a4dc-f305-5ed5-aedc-1a95e7980ad7 with identifier: PM75011
2026-03-30 09:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4966a4dc-f305-5ed5-aedc-1a95e7980ad7 with scrape type 2
2026-03-30 09:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4966a4dc-f305-5ed5-aedc-1a95e7980ad7 with scrape type 2
2026-03-30 09:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4966a4dc-f305-5ed5-aedc-1a95e7980ad7, identifier: PM75011
2026-03-30 09:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4966a4dc-f305-5ed5-aedc-1a95e7980ad7 with identifier: PM75011
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 09:00:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4966a4dc-f305-5ed5-aedc-1a95e7980ad7 with identifier: PM75011
2026-03-30 09:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4966a4dc-f305-5ed5-aedc-1a95e7980ad7 with identifier: PM75011 to the API
2026-03-30 09:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:11:00Z',
 'fuel_type': 'diesel',
 'id': '4966a4dc-f305-5ed5-aedc-1a95e7980ad7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM75011',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 104299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-09',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 M-Jet Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-03-30 09:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM75011%27 HTTP/1.1" 200 None
2026-03-30 09:00:21 [auto1.it] INFO: Saving data for PM75011: {'auction_closing_time': 1774969860.0, 'created_time': 1774440195.268951, 'last_price_update_time': 1774861221.834227}
2026-03-30 09:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM75011') HTTP/1.1" 204 0
2026-03-30 09:00:21 [auto1.it] INFO: Found listing with ID: XN71458
2026-03-30 09:00:21 [auto1.it] INFO: Found listing with ID: EM68882
2026-03-30 09:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM68882%27 HTTP/1.1" 200 None
2026-03-30 09:00:21 [auto1.it] INFO: Scrape type for EM68882: 2
2026-03-30 09:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 955c4a0c-460f-5253-a46c-9517955d297a with identifier: EM68882
2026-03-30 09:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 955c4a0c-460f-5253-a46c-9517955d297a with scrape type 2
2026-03-30 09:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 955c4a0c-460f-5253-a46c-9517955d297a with scrape type 2
2026-03-30 09:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 955c4a0c-460f-5253-a46c-9517955d297a, identifier: EM68882
2026-03-30 09:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 955c4a0c-460f-5253-a46c-9517955d297a with identifier: EM68882
2026-03-30 09:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 955c4a0c-460f-5253-a46c-9517955d297a with identifier: EM68882
2026-03-30 09:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 955c4a0c-460f-5253-a46c-9517955d297a with identifier: EM68882 to the API
2026-03-30 09:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:23Z',
 'fuel_type': 'diesel',
 'id': '955c4a0c-460f-5253-a46c-9517955d297a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM68882',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 188731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-27',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.2 D-4D',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM68882%27 HTTP/1.1" 200 None
2026-03-30 09:00:22 [auto1.it] INFO: Saving data for EM68882: {'auction_closing_time': 1774971743.0, 'created_time': 1774440217.873576, 'last_price_update_time': 1774861222.860486}
2026-03-30 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EM68882') HTTP/1.1" 204 0
2026-03-30 09:00:22 [auto1.it] INFO: Found listing with ID: AX59226
2026-03-30 09:00:22 [auto1.it] INFO: Found listing with ID: BS95687
2026-03-30 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS95687%27 HTTP/1.1" 200 None
2026-03-30 09:00:22 [auto1.it] INFO: Scrape type for BS95687: 0
2026-03-30 09:00:22 [auto1.it] INFO: Found listing with ID: PE32711
2026-03-30 09:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY37684/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:22 [auto1.it] INFO: Found listing with ID: TB20561
2026-03-30 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB20561%27 HTTP/1.1" 200 None
2026-03-30 09:00:22 [auto1.it] INFO: Scrape type for TB20561: 1
2026-03-30 09:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:22 [auto1.it] INFO: Found listing with ID: LR70386
2026-03-30 09:00:22 [auto1.it] INFO: Found listing with ID: VJ71364
2026-03-30 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ71364%27 HTTP/1.1" 200 None
2026-03-30 09:00:22 [auto1.it] INFO: Scrape type for VJ71364: 2
2026-03-30 09:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d5c90ee-4fba-5a6d-8c90-866376d13d2c with identifier: VJ71364
2026-03-30 09:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d5c90ee-4fba-5a6d-8c90-866376d13d2c with scrape type 2
2026-03-30 09:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d5c90ee-4fba-5a6d-8c90-866376d13d2c with scrape type 2
2026-03-30 09:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1d5c90ee-4fba-5a6d-8c90-866376d13d2c, identifier: VJ71364
2026-03-30 09:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1d5c90ee-4fba-5a6d-8c90-866376d13d2c with identifier: VJ71364
2026-03-30 09:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 09:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1d5c90ee-4fba-5a6d-8c90-866376d13d2c with identifier: VJ71364
2026-03-30 09:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1d5c90ee-4fba-5a6d-8c90-866376d13d2c with identifier: VJ71364 to the API
2026-03-30 09:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:14:20Z',
 'fuel_type': 'petrol',
 'id': '1d5c90ee-4fba-5a6d-8c90-866376d13d2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ71364',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 138879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-31',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2022}
2026-03-30 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ71364%27 HTTP/1.1" 200 None
2026-03-30 09:00:24 [auto1.it] INFO: Saving data for VJ71364: {'auction_closing_time': 1774970060.0, 'created_time': 1773233357.14986, 'last_price_update_time': 1774861224.79842}
2026-03-30 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VJ71364') HTTP/1.1" 204 0
2026-03-30 09:00:24 [auto1.it] INFO: Found listing with ID: XY37684
2026-03-30 09:00:24 [auto1.it] INFO: Found listing with ID: GD09579
2026-03-30 09:00:24 [auto1.it] INFO: Found listing with ID: RA79730
2026-03-30 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA79730%27 HTTP/1.1" 200 None
2026-03-30 09:00:24 [auto1.it] INFO: Scrape type for RA79730: 2
2026-03-30 09:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d037207e-7bdc-595f-bfaf-94e745e58853 with identifier: RA79730
2026-03-30 09:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d037207e-7bdc-595f-bfaf-94e745e58853 with scrape type 2
2026-03-30 09:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d037207e-7bdc-595f-bfaf-94e745e58853 with scrape type 2
2026-03-30 09:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d037207e-7bdc-595f-bfaf-94e745e58853, identifier: RA79730
2026-03-30 09:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d037207e-7bdc-595f-bfaf-94e745e58853 with identifier: RA79730
2026-03-30 09:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d037207e-7bdc-595f-bfaf-94e745e58853 with identifier: RA79730
2026-03-30 09:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d037207e-7bdc-595f-bfaf-94e745e58853 with identifier: RA79730 to the API
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:37:33Z',
 'fuel_type': 'petrol',
 'id': 'd037207e-7bdc-595f-bfaf-94e745e58853',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA79730',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 132004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-13',
 'seller_name': None,
 'title': 'Hyundai i30 1.0 T-GDI Mild-Hybrid Prime',
 'transmission': 'automatic',
 'trim': 'Prime',
 'year': 2022}
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA79730%27 HTTP/1.1" 200 None
2026-03-30 09:00:25 [auto1.it] INFO: Saving data for RA79730: {'auction_closing_time': 1774971453.0, 'created_time': 1774353808.407907, 'last_price_update_time': 1774861225.581796}
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA79730') HTTP/1.1" 204 0
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: NA99278
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: FD34465
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: TT47186
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT47186%27 HTTP/1.1" 200 None
2026-03-30 09:00:25 [auto1.it] INFO: Scrape type for TT47186: 0
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: RX48220
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: KC51409
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: PT97539
2026-03-30 09:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX48220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: TF73958
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF73958%27 HTTP/1.1" 200 None
2026-03-30 09:00:25 [auto1.it] INFO: Scrape type for TF73958: 0
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: TM12989
2026-03-30 09:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: DH32592
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: RD99785
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD99785%27 HTTP/1.1" 200 None
2026-03-30 09:00:25 [auto1.it] INFO: Scrape type for RD99785: 0
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: ER70142
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: XW57300
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: AR14989
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: XY74656
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: XF75948
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: BJ45035
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: XU90794
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: XZ58879
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: PM75011
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM75011%27 HTTP/1.1" 200 None
2026-03-30 09:00:25 [auto1.it] INFO: Scrape type for PM75011: 0
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: EM68882
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM68882%27 HTTP/1.1" 200 None
2026-03-30 09:00:25 [auto1.it] INFO: Scrape type for EM68882: 0
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: TB20561
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: VJ71364
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ71364%27 HTTP/1.1" 200 None
2026-03-30 09:00:25 [auto1.it] INFO: Scrape type for VJ71364: 0
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: GD09579
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: RA79730
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA79730%27 HTTP/1.1" 200 None
2026-03-30 09:00:25 [auto1.it] INFO: Scrape type for RA79730: 0
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: KC51409
2026-03-30 09:00:25 [auto1.it] INFO: Found listing with ID: PT97539
2026-03-30 09:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM12989/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP54883> (referer: https://www.auto1.com/v1/car-details-view/TP54883/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb2ef62d-81fd-55da-a334-042e161f797a with identifier: TP54883
2026-03-30 09:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb2ef62d-81fd-55da-a334-042e161f797a with scrape type 1
2026-03-30 09:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb2ef62d-81fd-55da-a334-042e161f797a
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_7f9b1aed153c1cb90649bb30b3076c4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_7f9b1aed153c1cb90649bb30b3076c4c.jpg not downloaded yet
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_6e3a80e1d9382182d963267597141cc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_6e3a80e1d9382182d963267597141cc7.jpg not downloaded yet
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_6650df2dc45495ae9851665b4b3d3503.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_6650df2dc45495ae9851665b4b3d3503.jpg not downloaded yet
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_eeb9adebb7f53d8615b218a7f08f485d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_eeb9adebb7f53d8615b218a7f08f485d.jpg not downloaded yet
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_ed2c359b8c9c35f44dc96789692e9191.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_ed2c359b8c9c35f44dc96789692e9191.jpg not downloaded yet
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_e6b884bb4bd6566bdbf0ae9221ff4e75.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_e6b884bb4bd6566bdbf0ae9221ff4e75.jpg not downloaded yet
2026-03-30 09:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_686a4bc58579d731087a3cd047adc897.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_686a4bc58579d731087a3cd047adc897.jpg not downloaded yet
2026-03-30 09:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ER70142/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU90794/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_82239a63ef329484dc61762e49fdfbcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_82239a63ef329484dc61762e49fdfbcc.jpg not downloaded yet
2026-03-30 09:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_08bfd94c12ba1570c608f034603baabe.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_08bfd94c12ba1570c608f034603baabe.jpg not downloaded yet
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_041b66d55e4b4fd16cf5f848c4c5b1be.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_041b66d55e4b4fd16cf5f848c4c5b1be.jpg not downloaded yet
2026-03-30 09:00:26 [auto1.it] INFO: Channel: 24h | Page: 2 | totalHits: 3283 | hits on page: 40
2026-03-30 09:00:26 [auto1.it] INFO: Found listing with ID: BT13926
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT13926%27 HTTP/1.1" 200 None
2026-03-30 09:00:26 [auto1.it] INFO: Scrape type for BT13926: 1
2026-03-30 09:00:26 [auto1.it] INFO: Found listing with ID: TF50576
2026-03-30 09:00:26 [auto1.it] INFO: Found listing with ID: YW32826
2026-03-30 09:00:26 [auto1.it] INFO: Found listing with ID: AD37859
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD37859%27 HTTP/1.1" 200 None
2026-03-30 09:00:26 [auto1.it] INFO: Scrape type for AD37859: 1
2026-03-30 09:00:26 [auto1.it] INFO: Found listing with ID: DR91409
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR91409%27 HTTP/1.1" 200 None
2026-03-30 09:00:26 [auto1.it] INFO: Scrape type for DR91409: 2
2026-03-30 09:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1244e770-bcc6-5620-88e8-67496db0d111 with identifier: DR91409
2026-03-30 09:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1244e770-bcc6-5620-88e8-67496db0d111 with scrape type 2
2026-03-30 09:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1244e770-bcc6-5620-88e8-67496db0d111 with scrape type 2
2026-03-30 09:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1244e770-bcc6-5620-88e8-67496db0d111, identifier: DR91409
2026-03-30 09:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1244e770-bcc6-5620-88e8-67496db0d111 with identifier: DR91409
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 09:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1244e770-bcc6-5620-88e8-67496db0d111 with identifier: DR91409
2026-03-30 09:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1244e770-bcc6-5620-88e8-67496db0d111 with identifier: DR91409 to the API
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:04:11Z',
 'fuel_type': 'diesel',
 'id': '1244e770-bcc6-5620-88e8-67496db0d111',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR91409',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 110461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Jeep Renegade 2.0 M-Jet Sport 4WD',
 'transmission': 'manual',
 'trim': 'Sport 4WD',
 'year': 2017}
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR91409%27 HTTP/1.1" 200 None
2026-03-30 09:00:27 [auto1.it] INFO: Saving data for DR91409: {'auction_closing_time': 1774969451.0, 'created_time': 1774126999.09165, 'last_price_update_time': 1774861227.751046}
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DR91409') HTTP/1.1" 204 0
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: TW08146
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: BP95163
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP95163%27 HTTP/1.1" 200 None
2026-03-30 09:00:27 [auto1.it] INFO: Scrape type for BP95163: 1
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: JV33372
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV33372%27 HTTP/1.1" 200 None
2026-03-30 09:00:27 [auto1.it] INFO: Scrape type for JV33372: 1
2026-03-30 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE32711> (referer: https://www.auto1.com/v1/car-details-view/PE32711/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XN71458> (referer: https://www.auto1.com/v1/car-details-view/XN71458/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS72345> (referer: https://www.auto1.com/v1/car-details-view/KS72345/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: UZ43487
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ43487%27 HTTP/1.1" 200 None
2026-03-30 09:00:27 [auto1.it] INFO: Scrape type for UZ43487: 1
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: JL77686
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: AK61800
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: UG78231
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: XR95165
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: PU84761
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: WR13144
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: KA38100
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: HL94253
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: RC63187
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: CZ89669
2026-03-30 09:00:27 [auto1.it] INFO: Found listing with ID: ZD15885
2026-03-30 09:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD15885%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [auto1.it] INFO: Scrape type for ZD15885: 1
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: SR04366
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR04366%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [auto1.it] INFO: Scrape type for SR04366: 1
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: EL85999
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: BE54405
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE54405%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [auto1.it] INFO: Scrape type for BE54405: 1
2026-03-30 09:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f13a6768-d5ab-5299-b5b5-5f617cd1b501 with identifier: PE32711
2026-03-30 09:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f13a6768-d5ab-5299-b5b5-5f617cd1b501 with scrape type 1
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f13a6768-d5ab-5299-b5b5-5f617cd1b501
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_8af7556d1a63e165f11d4bed743f6188.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_8af7556d1a63e165f11d4bed743f6188.jpg not downloaded yet
2026-03-30 09:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5b0f44d-37f3-5ccf-8278-f60cac50edd7 with identifier: XN71458
2026-03-30 09:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7 with scrape type 1
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_a5daf44f2e8812acf4c16267a8de6a18.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_a5daf44f2e8812acf4c16267a8de6a18.jpg not downloaded yet
2026-03-30 09:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6ccda8f-82b6-5052-b931-82cd4e0addec with identifier: KS72345
2026-03-30 09:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6ccda8f-82b6-5052-b931-82cd4e0addec with scrape type 1
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6ccda8f-82b6-5052-b931-82cd4e0addec
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_00c4a6f7e617bcbcc81edeeba87efc0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_00c4a6f7e617bcbcc81edeeba87efc0b.jpg not downloaded yet
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: FG27064
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: UN22377
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: YN38786
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: MC43872
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: WY72702
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY72702%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [auto1.it] INFO: Scrape type for WY72702: 1
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_0c0d5a4c51472c5af041cc454f47a044.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_0c0d5a4c51472c5af041cc454f47a044.jpg not downloaded yet
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_a25a6b5ecdcf920bcadd37ded0ed15cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_a25a6b5ecdcf920bcadd37ded0ed15cd.jpg not downloaded yet
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_5296314e0e17065a5d193ce8f1daf6f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_5296314e0e17065a5d193ce8f1daf6f0.jpg not downloaded yet
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: TX80167
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX80167%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [auto1.it] INFO: Scrape type for TX80167: 1
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_acd2c5fb23b76298bc1e4c4a1deef161.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_acd2c5fb23b76298bc1e4c4a1deef161.jpg not downloaded yet
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_bae2f8a68e6223bedd80d1caf791fdb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_bae2f8a68e6223bedd80d1caf791fdb7.jpg not downloaded yet
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_13025e12ae1a93f1a66b82b73e337dc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_13025e12ae1a93f1a66b82b73e337dc9.jpg not downloaded yet
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: DP93203
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP93203%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [auto1.it] INFO: Scrape type for DP93203: 1
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_2f263146e6f6af1397c4475cf0fff4ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_2f263146e6f6af1397c4475cf0fff4ab.jpg not downloaded yet
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_67f1ccdd73b3aa494424cba1be271154.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_67f1ccdd73b3aa494424cba1be271154.jpg not downloaded yet
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_99724f21893676bb3630781782e1b71d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_99724f21893676bb3630781782e1b71d.jpg not downloaded yet
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: YR35596
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: XA12696
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XA12696%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [auto1.it] INFO: Scrape type for XA12696: 1
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_348664629d15d6203741e5dae8242c9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_348664629d15d6203741e5dae8242c9e.jpg not downloaded yet
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_8015e834436fa2a05d15284f447338bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_8015e834436fa2a05d15284f447338bc.jpg not downloaded yet
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_3be9b47e19bf6b80a87d09ffe0be11d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_3be9b47e19bf6b80a87d09ffe0be11d6.jpg not downloaded yet
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: NS88104
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: FL65861
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL65861%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [auto1.it] INFO: Scrape type for FL65861: 1
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_5d9eab947fb9c45dbbc8fdbaf8eeec1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_5d9eab947fb9c45dbbc8fdbaf8eeec1f.jpg not downloaded yet
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_c974747d12fb7b7d038b557c1ff48c1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_c974747d12fb7b7d038b557c1ff48c1a.jpg not downloaded yet
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_7a6304ffdce47e6fc6a183fb19d1f6b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_7a6304ffdce47e6fc6a183fb19d1f6b0.jpg not downloaded yet
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: VV86242
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV86242%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [auto1.it] INFO: Scrape type for VV86242: 1
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_7ae4752240f5b2abcafcc4d00dcbcb62.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_7ae4752240f5b2abcafcc4d00dcbcb62.jpg not downloaded yet
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_97a9bac5fa8975376fa1147f3acb4310.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_97a9bac5fa8975376fa1147f3acb4310.jpg not downloaded yet
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_4230567c922b0c1b255b2480a2ce224f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_4230567c922b0c1b255b2480a2ce224f.jpg not downloaded yet
2026-03-30 09:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_6e3a80e1d9382182d963267597141cc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_7f9b1aed153c1cb90649bb30b3076c4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_e6b884bb4bd6566bdbf0ae9221ff4e75.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: XJ13017
2026-03-30 09:00:28 [auto1.it] INFO: Found listing with ID: WJ94048
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ94048%27 HTTP/1.1" 200 None
2026-03-30 09:00:28 [auto1.it] INFO: Scrape type for WJ94048: 2
2026-03-30 09:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79be0693-d01e-5681-96da-fe5122998b9d with identifier: WJ94048
2026-03-30 09:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79be0693-d01e-5681-96da-fe5122998b9d with scrape type 2
2026-03-30 09:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79be0693-d01e-5681-96da-fe5122998b9d with scrape type 2
2026-03-30 09:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 79be0693-d01e-5681-96da-fe5122998b9d, identifier: WJ94048
2026-03-30 09:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 79be0693-d01e-5681-96da-fe5122998b9d with identifier: WJ94048
2026-03-30 09:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 79be0693-d01e-5681-96da-fe5122998b9d with identifier: WJ94048
2026-03-30 09:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 79be0693-d01e-5681-96da-fe5122998b9d with identifier: WJ94048 to the API
2026-03-30 09:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:25:12Z',
 'fuel_type': 'diesel',
 'id': '79be0693-d01e-5681-96da-fe5122998b9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ94048',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 332567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-13',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion Executive',
 'transmission': 'automatic',
 'trim': 'BlueMotion Executive',
 'year': 2014}
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ94048%27 HTTP/1.1" 200 None
2026-03-30 09:00:29 [auto1.it] INFO: Saving data for WJ94048: {'auction_closing_time': 1774970712.0, 'created_time': 1772222463.379147, 'last_price_update_time': 1774861229.48936}
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WJ94048') HTTP/1.1" 204 0
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_36084b29fafad5982995dc96d0fea579.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_36084b29fafad5982995dc96d0fea579.jpg not downloaded yet
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_3276e71a1ee006a0e893a15c89a9e74e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_3276e71a1ee006a0e893a15c89a9e74e.jpg not downloaded yet
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_96eee7bb59cbf60ce2e55a6fa719ae31.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_96eee7bb59cbf60ce2e55a6fa719ae31.jpg not downloaded yet
2026-03-30 09:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR70386> (referer: https://www.auto1.com/v1/car-details-view/LR70386/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:29 [auto1.it] INFO: Found listing with ID: ZF45749
2026-03-30 09:00:29 [auto1.it] INFO: Found listing with ID: HT40305
2026-03-30 09:00:29 [auto1.it] INFO: Found listing with ID: GS61581
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS61581%27 HTTP/1.1" 200 None
2026-03-30 09:00:29 [auto1.it] INFO: Scrape type for GS61581: 1
2026-03-30 09:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB20561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_f0ae856b0e0ea4244c0283086e909468.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_f0ae856b0e0ea4244c0283086e909468.jpg not downloaded yet
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_3e7721bcb541a5b7bfe7ad05af8d3f64.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_3e7721bcb541a5b7bfe7ad05af8d3f64.jpg not downloaded yet
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_fec174bc28be6dc5fba974bb6a880542.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_fec174bc28be6dc5fba974bb6a880542.jpg not downloaded yet
2026-03-30 09:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL93075> (referer: https://www.auto1.com/v1/car-details-view/WL93075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX48220> (referer: https://www.auto1.com/v1/car-details-view/RX48220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY37684> (referer: https://www.auto1.com/v1/car-details-view/XY37684/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY74656/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 09:00:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 09:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d138890>
2026-03-30 09:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2106
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_6e3a80e1d9382182d963267597141cc7.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_6e3a80e1d9382182d963267597141cc7.jpg saved to cache
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb2ef62d-81fd-55da-a334-042e161f797a
2026-03-30 09:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e90f50>
2026-03-30 09:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_7f9b1aed153c1cb90649bb30b3076c4c.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_7f9b1aed153c1cb90649bb30b3076c4c.jpg saved to cache
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb2ef62d-81fd-55da-a334-042e161f797a
2026-03-30 09:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06366950>
2026-03-30 09:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_e6b884bb4bd6566bdbf0ae9221ff4e75.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_e6b884bb4bd6566bdbf0ae9221ff4e75.jpg saved to cache
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb2ef62d-81fd-55da-a334-042e161f797a
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_16b6538b775e12d4af7a43094d5460cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_16b6538b775e12d4af7a43094d5460cb.jpg not downloaded yet
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_aef67b7489f2f00bc4bd9791de38ebfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_aef67b7489f2f00bc4bd9791de38ebfd.jpg not downloaded yet
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_58f8127bcb7c07695ade871aa16a83fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_58f8127bcb7c07695ade871aa16a83fe.jpg not downloaded yet
2026-03-30 09:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_686a4bc58579d731087a3cd047adc897.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_4230567c922b0c1b255b2480a2ce224f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecd06d17-b9a7-5350-8a2c-1cf411b74185 with identifier: LR70386
2026-03-30 09:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecd06d17-b9a7-5350-8a2c-1cf411b74185 with scrape type 1
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ecd06d17-b9a7-5350-8a2c-1cf411b74185
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa4%252Fc6a4925d6dc1c518a1b15b1472e09741%252Fpa%252FLR70386_669831a7b4d5c6fea0ba7c4e7980e505.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_669831a7b4d5c6fea0ba7c4e7980e505.jpg already downloaded
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa4%252Fc6a4925d6dc1c518a1b15b1472e09741%252Fpa%252FLR70386_208e5883ec1b4bf00261355940af1e12.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_208e5883ec1b4bf00261355940af1e12.jpg already downloaded
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa4%252Fc6a4925d6dc1c518a1b15b1472e09741%252Fpa%252FLR70386_a0cefcdc615d4a7911ab1207f5995d1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_a0cefcdc615d4a7911ab1207f5995d1e.jpg already downloaded
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa4%252Fc6a4925d6dc1c518a1b15b1472e09741%252Fpa%252FLR70386_10ea0ba3f07e9cab5a51e7fd19aa1869.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_10ea0ba3f07e9cab5a51e7fd19aa1869.jpg already downloaded
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa4%252Fc6a4925d6dc1c518a1b15b1472e09741%252Fpa%252FLR70386_fa5f342a698bec96ca3a94c2b19862e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_fa5f342a698bec96ca3a94c2b19862e9.jpg already downloaded
2026-03-30 09:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ecd06d17-b9a7-5350-8a2c-1cf411b74185, identifier: LR70386
2026-03-30 09:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN50634> (referer: https://www.auto1.com/v1/car-details-view/JN50634/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ecd06d17-b9a7-5350-8a2c-1cf411b74185 with identifier: LR70386
2026-03-30 09:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ecd06d17-b9a7-5350-8a2c-1cf411b74185 with identifier: LR70386
2026-03-30 09:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ecd06d17-b9a7-5350-8a2c-1cf411b74185 with identifier: LR70386 to the API
2026-03-30 09:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LR70386>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:49:45Z',
 'fuel_type': 'petrol',
 'id': 'ecd06d17-b9a7-5350-8a2c-1cf411b74185',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR70386',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 122601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_669831a7b4d5c6fea0ba7c4e7980e505.jpg',
                'https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_208e5883ec1b4bf00261355940af1e12.jpg',
                'https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_a0cefcdc615d4a7911ab1207f5995d1e.jpg',
                'https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_10ea0ba3f07e9cab5a51e7fd19aa1869.jpg',
                'https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_fa5f342a698bec96ca3a94c2b19862e9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecd06d17-b9a7-5350-8a2c-1cf411b74185/ecd06d17-b9a7-5350-8a2c-1cf411b74185_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_669831a7b4d5c6fea0ba7c4e7980e505.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecd06d17-b9a7-5350-8a2c-1cf411b74185/ecd06d17-b9a7-5350-8a2c-1cf411b74185_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_208e5883ec1b4bf00261355940af1e12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecd06d17-b9a7-5350-8a2c-1cf411b74185/ecd06d17-b9a7-5350-8a2c-1cf411b74185_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_a0cefcdc615d4a7911ab1207f5995d1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecd06d17-b9a7-5350-8a2c-1cf411b74185/ecd06d17-b9a7-5350-8a2c-1cf411b74185_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_10ea0ba3f07e9cab5a51e7fd19aa1869.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecd06d17-b9a7-5350-8a2c-1cf411b74185/ecd06d17-b9a7-5350-8a2c-1cf411b74185_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a4/c6a4925d6dc1c518a1b15b1472e09741/pa/LR70386_fa5f342a698bec96ca3a94c2b19862e9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR70386%27 HTTP/1.1" 200 None
2026-03-30 09:00:31 [auto1.it] INFO: Saving data for LR70386: {'created_time': 1774861231.61478, 'last_price_update_time': 1774861231.614794, 'auction_closing_time': 1774972185.0}
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LR70386') HTTP/1.1" 204 0
2026-03-30 09:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c73803d-d5dc-5bdb-aadc-cbe2741945a8 with identifier: WL93075
2026-03-30 09:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c73803d-d5dc-5bdb-aadc-cbe2741945a8 with scrape type 1
2026-03-30 09:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9c73803d-d5dc-5bdb-aadc-cbe2741945a8
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F6d%252Fdb6d37b96c082f3b75e15ffd48e14339%252Fpa%252FWL93075_d1efd91e92925e8e58d1f89fa5b523d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_d1efd91e92925e8e58d1f89fa5b523d7.jpg not downloaded yet
2026-03-30 09:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a042620-5b1b-5567-a541-4a05c052fbcf with identifier: RX48220
2026-03-30 09:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a042620-5b1b-5567-a541-4a05c052fbcf with scrape type 1
2026-03-30 09:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a042620-5b1b-5567-a541-4a05c052fbcf
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_4a8c44d796302582790250726d36faf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_4a8c44d796302582790250726d36faf1.jpg not downloaded yet
2026-03-30 09:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e683f7b-8d5a-5801-a492-40c117477db5 with identifier: XY37684
2026-03-30 09:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e683f7b-8d5a-5801-a492-40c117477db5 with scrape type 1
2026-03-30 09:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e683f7b-8d5a-5801-a492-40c117477db5
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_b8c585879eca0c221f50871f5aa16398.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_b8c585879eca0c221f50871f5aa16398.jpg not downloaded yet
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F6d%252Fdb6d37b96c082f3b75e15ffd48e14339%252Fpa%252FWL93075_9a1dfff1f58cf6fc8af041503e24c141.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_9a1dfff1f58cf6fc8af041503e24c141.jpg not downloaded yet
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_1ca761e0526465c1c920a9641db9a711.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_1ca761e0526465c1c920a9641db9a711.jpg not downloaded yet
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_645674af1dda7543c96ecde4bf2c76bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_645674af1dda7543c96ecde4bf2c76bc.jpg not downloaded yet
2026-03-30 09:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fccf50>
2026-03-30 09:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_686a4bc58579d731087a3cd047adc897.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_686a4bc58579d731087a3cd047adc897.jpg saved to cache
2026-03-30 09:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb2ef62d-81fd-55da-a334-042e161f797a
2026-03-30 09:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d0d9d0>
2026-03-30 09:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_4230567c922b0c1b255b2480a2ce224f.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_4230567c922b0c1b255b2480a2ce224f.jpg saved to cache
2026-03-30 09:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6ccda8f-82b6-5052-b931-82cd4e0addec
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F6d%252Fdb6d37b96c082f3b75e15ffd48e14339%252Fpa%252FWL93075_198af5b69f1360eea9561f1731985b2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_198af5b69f1360eea9561f1731985b2d.jpg not downloaded yet
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_eadd2198f644342ae86db578ebae427d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_eadd2198f644342ae86db578ebae427d.jpg not downloaded yet
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_74ebe4ab70ab1629f0613a775bf5da74.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_74ebe4ab70ab1629f0613a775bf5da74.jpg not downloaded yet
2026-03-30 09:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12108155-eb30-5ad6-8acf-b13b74dc2e8c with identifier: JN50634
2026-03-30 09:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12108155-eb30-5ad6-8acf-b13b74dc2e8c with scrape type 1
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12108155-eb30-5ad6-8acf-b13b74dc2e8c
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fdb%252Fdddbe264ad13ca14128bcc0656082fd9%252Fpa%252FJN50634_657cc5114baa3ff9354c17d956fd54f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_657cc5114baa3ff9354c17d956fd54f1.jpg already downloaded
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fdb%252Fdddbe264ad13ca14128bcc0656082fd9%252Fpa%252FJN50634_6f909f7dbec7b519bb8e119fe3c7d0c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_6f909f7dbec7b519bb8e119fe3c7d0c2.jpg already downloaded
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fdb%252Fdddbe264ad13ca14128bcc0656082fd9%252Fpa%252FJN50634_7d0a8c0c0546f627834c0d70490b973e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_7d0a8c0c0546f627834c0d70490b973e.jpg already downloaded
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fdb%252Fdddbe264ad13ca14128bcc0656082fd9%252Fpa%252FJN50634_06113d41102b29f2a7972028ae14e7ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_06113d41102b29f2a7972028ae14e7ac.jpg already downloaded
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fdb%252Fdddbe264ad13ca14128bcc0656082fd9%252Fpa%252FJN50634_a236f742f105095bcb280d0a3d860fcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_a236f742f105095bcb280d0a3d860fcd.jpg already downloaded
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fdb%252Fdddbe264ad13ca14128bcc0656082fd9%252Fpa%252FJN50634_78a849a9f46958f22d171187987355c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_78a849a9f46958f22d171187987355c8.jpg already downloaded
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fdb%252Fdddbe264ad13ca14128bcc0656082fd9%252Fpa%252FJN50634_dbef3101dd1c70b731d0baa83226a7dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_dbef3101dd1c70b731d0baa83226a7dd.jpg already downloaded
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fdb%252Fdddbe264ad13ca14128bcc0656082fd9%252Fpa%252FJN50634_7f256b341e3007fd226c5432587985c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_7f256b341e3007fd226c5432587985c2.jpg already downloaded
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fdb%252Fdddbe264ad13ca14128bcc0656082fd9%252Fpa%252FJN50634_f9c526e078212fed39505b55af7cc67e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_f9c526e078212fed39505b55af7cc67e.jpg already downloaded
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fdb%252Fdddbe264ad13ca14128bcc0656082fd9%252Fpa%252FJN50634_7b2ed88658f0e0ceb6ad20974ac1706f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_7b2ed88658f0e0ceb6ad20974ac1706f.jpg already downloaded
2026-03-30 09:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 12108155-eb30-5ad6-8acf-b13b74dc2e8c, identifier: JN50634
2026-03-30 09:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 12108155-eb30-5ad6-8acf-b13b74dc2e8c with identifier: JN50634
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 09:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 12108155-eb30-5ad6-8acf-b13b74dc2e8c with identifier: JN50634
2026-03-30 09:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 12108155-eb30-5ad6-8acf-b13b74dc2e8c with identifier: JN50634 to the API
2026-03-30 09:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JN50634>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:19:44Z',
 'fuel_type': 'petrol',
 'id': '12108155-eb30-5ad6-8acf-b13b74dc2e8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN50634',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Fiat',
 'model': '600',
 'odometer': 12858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_657cc5114baa3ff9354c17d956fd54f1.jpg',
                'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_6f909f7dbec7b519bb8e119fe3c7d0c2.jpg',
                'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_7d0a8c0c0546f627834c0d70490b973e.jpg',
                'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_06113d41102b29f2a7972028ae14e7ac.jpg',
                'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_a236f742f105095bcb280d0a3d860fcd.jpg',
                'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_78a849a9f46958f22d171187987355c8.jpg',
                'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_dbef3101dd1c70b731d0baa83226a7dd.jpg',
                'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_7f256b341e3007fd226c5432587985c2.jpg',
                'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_f9c526e078212fed39505b55af7cc67e.jpg',
                'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_7b2ed88658f0e0ceb6ad20974ac1706f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12108155-eb30-5ad6-8acf-b13b74dc2e8c/12108155-eb30-5ad6-8acf-b13b74dc2e8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_657cc5114baa3ff9354c17d956fd54f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12108155-eb30-5ad6-8acf-b13b74dc2e8c/12108155-eb30-5ad6-8acf-b13b74dc2e8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3343673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_6f909f7dbec7b519bb8e119fe3c7d0c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12108155-eb30-5ad6-8acf-b13b74dc2e8c/12108155-eb30-5ad6-8acf-b13b74dc2e8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3186067,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_7d0a8c0c0546f627834c0d70490b973e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12108155-eb30-5ad6-8acf-b13b74dc2e8c/12108155-eb30-5ad6-8acf-b13b74dc2e8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3289869,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_06113d41102b29f2a7972028ae14e7ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12108155-eb30-5ad6-8acf-b13b74dc2e8c/12108155-eb30-5ad6-8acf-b13b74dc2e8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3232690,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_a236f742f105095bcb280d0a3d860fcd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12108155-eb30-5ad6-8acf-b13b74dc2e8c/12108155-eb30-5ad6-8acf-b13b74dc2e8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2711302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_78a849a9f46958f22d171187987355c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12108155-eb30-5ad6-8acf-b13b74dc2e8c/12108155-eb30-5ad6-8acf-b13b74dc2e8c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576278,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_dbef3101dd1c70b731d0baa83226a7dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12108155-eb30-5ad6-8acf-b13b74dc2e8c/12108155-eb30-5ad6-8acf-b13b74dc2e8c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2945710,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_7f256b341e3007fd226c5432587985c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12108155-eb30-5ad6-8acf-b13b74dc2e8c/12108155-eb30-5ad6-8acf-b13b74dc2e8c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3635633,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_f9c526e078212fed39505b55af7cc67e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12108155-eb30-5ad6-8acf-b13b74dc2e8c/12108155-eb30-5ad6-8acf-b13b74dc2e8c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3186547,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/db/dddbe264ad13ca14128bcc0656082fd9/pa/JN50634_7b2ed88658f0e0ceb6ad20974ac1706f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 600 1.2 Mild-Hybrid La Prima',
 'transmission': 'automatic',
 'trim': 'La Prima',
 'year': 2025}
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN50634%27 HTTP/1.1" 200 None
2026-03-30 09:00:33 [auto1.it] INFO: Saving data for JN50634: {'created_time': 1774861233.70691, 'last_price_update_time': 1774861233.706922, 'auction_closing_time': 1774970384.0}
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JN50634') HTTP/1.1" 204 0
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F6d%252Fdb6d37b96c082f3b75e15ffd48e14339%252Fpa%252FWL93075_42b6abf176ab67ef8ca4c3b9042fc660.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_42b6abf176ab67ef8ca4c3b9042fc660.jpg not downloaded yet
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_1c10f3915c322a8779e070c7c05baca1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_1c10f3915c322a8779e070c7c05baca1.jpg not downloaded yet
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_70815f2e33e261de546187a3757dd9da.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_70815f2e33e261de546187a3757dd9da.jpg not downloaded yet
2026-03-30 09:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS61581/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F6d%252Fdb6d37b96c082f3b75e15ffd48e14339%252Fpa%252FWL93075_bdd74369af11fd519e5b65849ba63b2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_bdd74369af11fd519e5b65849ba63b2d.jpg not downloaded yet
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_9f2dd9af5fec890f2be39e8b3cda2d15.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_9f2dd9af5fec890f2be39e8b3cda2d15.jpg not downloaded yet
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_8a792d12f5571a80749dc5fb97d99bd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_8a792d12f5571a80749dc5fb97d99bd4.jpg not downloaded yet
2026-03-30 09:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP95163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ER70142> (referer: https://www.auto1.com/v1/car-details-view/ER70142/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU90794> (referer: https://www.auto1.com/v1/car-details-view/XU90794/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_845eeb8d458df6c34e8913ae81f6195f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_845eeb8d458df6c34e8913ae81f6195f.jpg not downloaded yet
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_f0e6b697dbdf3198bfc476e6f7e6af5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_f0e6b697dbdf3198bfc476e6f7e6af5f.jpg not downloaded yet
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_628b0f68c0eb7aa050f5d8bca7eff382.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_628b0f68c0eb7aa050f5d8bca7eff382.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_323fa0c91ca75213675339b4a7e43422.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_323fa0c91ca75213675339b4a7e43422.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_1217b5636ebf22d5cd595484741dad17.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_1217b5636ebf22d5cd595484741dad17.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_70ba10036aca184112c283815f7013c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_70ba10036aca184112c283815f7013c9.jpg not downloaded yet
2026-03-30 09:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_96eee7bb59cbf60ce2e55a6fa719ae31.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_fec174bc28be6dc5fba974bb6a880542.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_d61f7ec7ef3a46c524b7f3209e547772.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_d61f7ec7ef3a46c524b7f3209e547772.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_522d9fa79ce8fd6fc5cdf8baa51f752f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_522d9fa79ce8fd6fc5cdf8baa51f752f.jpg not downloaded yet
2026-03-30 09:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb0385cc-6131-561a-a274-20d15f45e9cf with identifier: ER70142
2026-03-30 09:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb0385cc-6131-561a-a274-20d15f45e9cf with scrape type 1
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb0385cc-6131-561a-a274-20d15f45e9cf
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_769050e98159c99394f33435c92d151e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_769050e98159c99394f33435c92d151e.jpg not downloaded yet
2026-03-30 09:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d with identifier: XU90794
2026-03-30 09:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d with scrape type 1
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_b65569fd93b3aca453277288da222154.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_b65569fd93b3aca453277288da222154.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_81bcf3f58dfa648fe2d82c26198c0b58.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_81bcf3f58dfa648fe2d82c26198c0b58.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_a7d8c25492614c0e8271bc3617bb4352.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_a7d8c25492614c0e8271bc3617bb4352.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_5954c141cc5b0d921467113c1ae320d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_5954c141cc5b0d921467113c1ae320d8.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_f9561af0063cf8c53098f61f8dd92897.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_f9561af0063cf8c53098f61f8dd92897.jpg not downloaded yet
2026-03-30 09:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c95f90>
2026-03-30 09:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_96eee7bb59cbf60ce2e55a6fa719ae31.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_96eee7bb59cbf60ce2e55a6fa719ae31.jpg saved to cache
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6ccda8f-82b6-5052-b931-82cd4e0addec
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_5884a63b328f5762bcf530a68180ff9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_5884a63b328f5762bcf530a68180ff9d.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_c30c90d997bc757995c5a6ac0167ea8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_c30c90d997bc757995c5a6ac0167ea8f.jpg not downloaded yet
2026-03-30 09:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cc7c90>
2026-03-30 09:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_fec174bc28be6dc5fba974bb6a880542.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_fec174bc28be6dc5fba974bb6a880542.jpg saved to cache
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6ccda8f-82b6-5052-b931-82cd4e0addec
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_71db162a3e463962bcef2a7f123241aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_71db162a3e463962bcef2a7f123241aa.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_48f238fc38a8ef065481f0b6833ebca2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_48f238fc38a8ef065481f0b6833ebca2.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_43db56bdbe123cbe29e5911b5f1bba6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_43db56bdbe123cbe29e5911b5f1bba6e.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_e2d2ed856844165cbdcd0ac4ec3ae476.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_e2d2ed856844165cbdcd0ac4ec3ae476.jpg not downloaded yet
2026-03-30 09:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_7ae4752240f5b2abcafcc4d00dcbcb62.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_6e69137f49c8388b2dc9be2c074fbded.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_6e69137f49c8388b2dc9be2c074fbded.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_2e4ad2fd318f95fd7acc825453ffceb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_2e4ad2fd318f95fd7acc825453ffceb1.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_f7e2d590ff1e81574e26b46a3376fa0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_f7e2d590ff1e81574e26b46a3376fa0a.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_32d8f299d0f123822d99396f38ad7a6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_32d8f299d0f123822d99396f38ad7a6a.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_912e25b6193e0be8b403fdff1c88a729.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_912e25b6193e0be8b403fdff1c88a729.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_21c89148f7523a09de3b6d15d379f067.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_21c89148f7523a09de3b6d15d379f067.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_03fa79b5305ff5be92aeae43c5ed932e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_03fa79b5305ff5be92aeae43c5ed932e.jpg not downloaded yet
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_9d2a77e48acb3a3d3ccf3e82944c2b0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_9d2a77e48acb3a3d3ccf3e82944c2b0f.jpg not downloaded yet
2026-03-30 09:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_f0ae856b0e0ea4244c0283086e909468.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063fa010>
2026-03-30 09:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_7ae4752240f5b2abcafcc4d00dcbcb62.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_7ae4752240f5b2abcafcc4d00dcbcb62.jpg saved to cache
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f13a6768-d5ab-5299-b5b5-5f617cd1b501
2026-03-30 09:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_97a9bac5fa8975376fa1147f3acb4310.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_c55c3170c25ba67c44be7841affd63a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_c55c3170c25ba67c44be7841affd63a8.jpg not downloaded yet
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_db892e68fc3337878fa3cc46c6e14766.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_db892e68fc3337878fa3cc46c6e14766.jpg not downloaded yet
2026-03-30 09:00:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0c48e010>
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_f0ae856b0e0ea4244c0283086e909468.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_f0ae856b0e0ea4244c0283086e909468.jpg saved to cache
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f13a6768-d5ab-5299-b5b5-5f617cd1b501
2026-03-30 09:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_42b6abf176ab67ef8ca4c3b9042fc660.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_3276e71a1ee006a0e893a15c89a9e74e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ea9710>
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_97a9bac5fa8975376fa1147f3acb4310.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_97a9bac5fa8975376fa1147f3acb4310.jpg saved to cache
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7
2026-03-30 09:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS61581> (referer: https://www.auto1.com/v1/car-details-view/GS61581/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_ed2c359b8c9c35f44dc96789692e9191.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_3e7721bcb541a5b7bfe7ad05af8d3f64.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d422d0>
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c73803d-d5dc-5bdb-aadc-cbe2741945a8/9c73803d-d5dc-5bdb-aadc-cbe2741945a8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F6d%252Fdb6d37b96c082f3b75e15ffd48e14339%252Fpa%252FWL93075_42b6abf176ab67ef8ca4c3b9042fc660.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_42b6abf176ab67ef8ca4c3b9042fc660.jpg saved to cache
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c73803d-d5dc-5bdb-aadc-cbe2741945a8
2026-03-30 09:00:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0cde5f90>
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_3276e71a1ee006a0e893a15c89a9e74e.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_3276e71a1ee006a0e893a15c89a9e74e.jpg saved to cache
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7
2026-03-30 09:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_70815f2e33e261de546187a3757dd9da.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_e2d2ed856844165cbdcd0ac4ec3ae476.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_36084b29fafad5982995dc96d0fea579.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6b20f6b-26a6-5f46-b121-129c6ecea859 with identifier: GS61581
2026-03-30 09:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b20f6b-26a6-5f46-b121-129c6ecea859 with scrape type 1
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6b20f6b-26a6-5f46-b121-129c6ecea859
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_85e1b3b6b0cb4230277064c1006213f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_85e1b3b6b0cb4230277064c1006213f2.jpg not downloaded yet
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ce1350>
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_ed2c359b8c9c35f44dc96789692e9191.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_ed2c359b8c9c35f44dc96789692e9191.jpg saved to cache
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb2ef62d-81fd-55da-a334-042e161f797a
2026-03-30 09:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c31650>
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_3e7721bcb541a5b7bfe7ad05af8d3f64.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_3e7721bcb541a5b7bfe7ad05af8d3f64.jpg saved to cache
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7
2026-03-30 09:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_db892e68fc3337878fa3cc46c6e14766.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_9d2a77e48acb3a3d3ccf3e82944c2b0f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_23ce1989f8885f04a1524e895cc5b996.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_23ce1989f8885f04a1524e895cc5b996.jpg not downloaded yet
2026-03-30 09:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_21c89148f7523a09de3b6d15d379f067.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY74656> (referer: https://www.auto1.com/v1/car-details-view/XY74656/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_822bbada0c7e8e205d5c1c8cfea442c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_822bbada0c7e8e205d5c1c8cfea442c4.jpg not downloaded yet
2026-03-30 09:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fc70d0>
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_70815f2e33e261de546187a3757dd9da.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_70815f2e33e261de546187a3757dd9da.jpg saved to cache
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e683f7b-8d5a-5801-a492-40c117477db5
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06383550>
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_e2d2ed856844165cbdcd0ac4ec3ae476.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_e2d2ed856844165cbdcd0ac4ec3ae476.jpg saved to cache
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d
2026-03-30 09:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cdae10>
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_36084b29fafad5982995dc96d0fea579.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_36084b29fafad5982995dc96d0fea579.jpg saved to cache
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f13a6768-d5ab-5299-b5b5-5f617cd1b501
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_28840b2787f8712ecb73a3c67f66294f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_28840b2787f8712ecb73a3c67f66294f.jpg not downloaded yet
2026-03-30 09:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM12989> (referer: https://www.auto1.com/v1/car-details-view/TM12989/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_b11b55c62461b7866a14cb5a69c94253.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_b11b55c62461b7866a14cb5a69c94253.jpg not downloaded yet
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fccf90>
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_db892e68fc3337878fa3cc46c6e14766.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_db892e68fc3337878fa3cc46c6e14766.jpg saved to cache
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cea6d0>
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_9d2a77e48acb3a3d3ccf3e82944c2b0f.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_9d2a77e48acb3a3d3ccf3e82944c2b0f.jpg saved to cache
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d30350>
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_21c89148f7523a09de3b6d15d379f067.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_21c89148f7523a09de3b6d15d379f067.jpg saved to cache
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d
2026-03-30 09:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3399f4fe-0db9-58a4-8e1a-1f07ad8076f0 with identifier: XY74656
2026-03-30 09:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3399f4fe-0db9-58a4-8e1a-1f07ad8076f0 with scrape type 1
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3399f4fe-0db9-58a4-8e1a-1f07ad8076f0
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F15%252F7c15bde8f9e1eaf6dd7f55f0c3ca93d9%252Fpa%252FXY74656_01c6bf82ad595c44a3f6f81de3270eae.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_01c6bf82ad595c44a3f6f81de3270eae.jpg already downloaded
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F15%252F7c15bde8f9e1eaf6dd7f55f0c3ca93d9%252Fpa%252FXY74656_7e77286c7a0bda55fb5a0c9708e5f90b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_7e77286c7a0bda55fb5a0c9708e5f90b.jpg already downloaded
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F15%252F7c15bde8f9e1eaf6dd7f55f0c3ca93d9%252Fpa%252FXY74656_f9f34f7e922b4481d98803fb55ed1015.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_f9f34f7e922b4481d98803fb55ed1015.jpg already downloaded
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F15%252F7c15bde8f9e1eaf6dd7f55f0c3ca93d9%252Fpa%252FXY74656_f1a969af626e5c614b5540abd2c09343.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_f1a969af626e5c614b5540abd2c09343.jpg already downloaded
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F15%252F7c15bde8f9e1eaf6dd7f55f0c3ca93d9%252Fpa%252FXY74656_23945a782bc86836b4c8e55175847c2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_23945a782bc86836b4c8e55175847c2a.jpg already downloaded
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F15%252F7c15bde8f9e1eaf6dd7f55f0c3ca93d9%252Fpa%252FXY74656_f88da2849ac2323d8862e32dc177c7eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_f88da2849ac2323d8862e32dc177c7eb.jpg already downloaded
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F15%252F7c15bde8f9e1eaf6dd7f55f0c3ca93d9%252Fpa%252FXY74656_c7dba702752f32aa951c69cffc7bd393.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_c7dba702752f32aa951c69cffc7bd393.jpg already downloaded
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F15%252F7c15bde8f9e1eaf6dd7f55f0c3ca93d9%252Fpa%252FXY74656_e448b628109779194a33408ba4ec7c4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_e448b628109779194a33408ba4ec7c4a.jpg already downloaded
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F15%252F7c15bde8f9e1eaf6dd7f55f0c3ca93d9%252Fpa%252FXY74656_beb9e4c5e9ed79c1fef1244fb6f8c4ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_beb9e4c5e9ed79c1fef1244fb6f8c4ed.jpg already downloaded
2026-03-30 09:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F15%252F7c15bde8f9e1eaf6dd7f55f0c3ca93d9%252Fpa%252FXY74656_3dbbf631bb5b8355ca675cde4d552895.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_3dbbf631bb5b8355ca675cde4d552895.jpg already downloaded
2026-03-30 09:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3399f4fe-0db9-58a4-8e1a-1f07ad8076f0, identifier: XY74656
2026-03-30 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_85e1b3b6b0cb4230277064c1006213f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_32d8f299d0f123822d99396f38ad7a6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_c836ade35d2666081158c28b39788ea9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_c836ade35d2666081158c28b39788ea9.jpg not downloaded yet
2026-03-30 09:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3399f4fe-0db9-58a4-8e1a-1f07ad8076f0 with identifier: XY74656
2026-03-30 09:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3399f4fe-0db9-58a4-8e1a-1f07ad8076f0 with identifier: XY74656
2026-03-30 09:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3399f4fe-0db9-58a4-8e1a-1f07ad8076f0 with identifier: XY74656 to the API
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XY74656>
{'auction_title': '',
 'c_o_2_emission_value': 1,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.9L',
 'engine_horse_power': 441,
 'expiration_date': '2026-03-31T15:43:05Z',
 'fuel_type': 'petrol',
 'id': '3399f4fe-0db9-58a4-8e1a-1f07ad8076f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY74656',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 98112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_01c6bf82ad595c44a3f6f81de3270eae.jpg',
                'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_7e77286c7a0bda55fb5a0c9708e5f90b.jpg',
                'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_f9f34f7e922b4481d98803fb55ed1015.jpg',
                'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_f1a969af626e5c614b5540abd2c09343.jpg',
                'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_23945a782bc86836b4c8e55175847c2a.jpg',
                'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_f88da2849ac2323d8862e32dc177c7eb.jpg',
                'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_c7dba702752f32aa951c69cffc7bd393.jpg',
                'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_e448b628109779194a33408ba4ec7c4a.jpg',
                'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_beb9e4c5e9ed79c1fef1244fb6f8c4ed.jpg',
                'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_3dbbf631bb5b8355ca675cde4d552895.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3399f4fe-0db9-58a4-8e1a-1f07ad8076f0/3399f4fe-0db9-58a4-8e1a-1f07ad8076f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_01c6bf82ad595c44a3f6f81de3270eae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3399f4fe-0db9-58a4-8e1a-1f07ad8076f0/3399f4fe-0db9-58a4-8e1a-1f07ad8076f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_7e77286c7a0bda55fb5a0c9708e5f90b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3399f4fe-0db9-58a4-8e1a-1f07ad8076f0/3399f4fe-0db9-58a4-8e1a-1f07ad8076f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2000255,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_f9f34f7e922b4481d98803fb55ed1015.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3399f4fe-0db9-58a4-8e1a-1f07ad8076f0/3399f4fe-0db9-58a4-8e1a-1f07ad8076f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1856436,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_f1a969af626e5c614b5540abd2c09343.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3399f4fe-0db9-58a4-8e1a-1f07ad8076f0/3399f4fe-0db9-58a4-8e1a-1f07ad8076f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_23945a782bc86836b4c8e55175847c2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3399f4fe-0db9-58a4-8e1a-1f07ad8076f0/3399f4fe-0db9-58a4-8e1a-1f07ad8076f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1927854,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_f88da2849ac2323d8862e32dc177c7eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3399f4fe-0db9-58a4-8e1a-1f07ad8076f0/3399f4fe-0db9-58a4-8e1a-1f07ad8076f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_c7dba702752f32aa951c69cffc7bd393.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3399f4fe-0db9-58a4-8e1a-1f07ad8076f0/3399f4fe-0db9-58a4-8e1a-1f07ad8076f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_e448b628109779194a33408ba4ec7c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3399f4fe-0db9-58a4-8e1a-1f07ad8076f0/3399f4fe-0db9-58a4-8e1a-1f07ad8076f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1882052,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_beb9e4c5e9ed79c1fef1244fb6f8c4ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3399f4fe-0db9-58a4-8e1a-1f07ad8076f0/3399f4fe-0db9-58a4-8e1a-1f07ad8076f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2237008,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/15/7c15bde8f9e1eaf6dd7f55f0c3ca93d9/pa/XY74656_3dbbf631bb5b8355ca675cde4d552895.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY74656%27 HTTP/1.1" 200 None
2026-03-30 09:00:37 [auto1.it] INFO: Saving data for XY74656: {'created_time': 1774861237.76425, 'last_price_update_time': 1774861237.764264, 'auction_closing_time': 1774971785.0}
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XY74656') HTTP/1.1" 204 0
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_c958af0c1ecf0e87612b4ea152447802.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_c958af0c1ecf0e87612b4ea152447802.jpg not downloaded yet
2026-03-30 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV86242/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_1c10f3915c322a8779e070c7c05baca1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_90dcbcf0314019ccfdab645318a3dfce.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_90dcbcf0314019ccfdab645318a3dfce.jpg not downloaded yet
2026-03-30 09:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b166d30-4359-56fc-b2e7-53db2f3acff7 with identifier: TM12989
2026-03-30 09:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b166d30-4359-56fc-b2e7-53db2f3acff7 with scrape type 1
2026-03-30 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b166d30-4359-56fc-b2e7-53db2f3acff7
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_805b2ed0146f7fa621f22d41949d3283.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_805b2ed0146f7fa621f22d41949d3283.jpg not downloaded yet
2026-03-30 09:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e46210>
2026-03-30 09:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_85e1b3b6b0cb4230277064c1006213f2.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_85e1b3b6b0cb4230277064c1006213f2.jpg saved to cache
2026-03-30 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6b20f6b-26a6-5f46-b121-129c6ecea859
2026-03-30 09:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d4ed10>
2026-03-30 09:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_32d8f299d0f123822d99396f38ad7a6a.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_32d8f299d0f123822d99396f38ad7a6a.jpg saved to cache
2026-03-30 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d
2026-03-30 09:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_2e4ad2fd318f95fd7acc825453ffceb1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_84af2384d539a6284818fd43258402c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_84af2384d539a6284818fd43258402c1.jpg not downloaded yet
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_63c2890e2cefb9dfdea0aa2aa0c89065.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_63c2890e2cefb9dfdea0aa2aa0c89065.jpg not downloaded yet
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_77755652f6ae6e353ecad0ea327d434a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_77755652f6ae6e353ecad0ea327d434a.jpg not downloaded yet
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_f9a36618f288f0048784baa7c84a99db.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_f9a36618f288f0048784baa7c84a99db.jpg not downloaded yet
2026-03-30 09:00:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f707d0>
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_1c10f3915c322a8779e070c7c05baca1.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_1c10f3915c322a8779e070c7c05baca1.jpg saved to cache
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a042620-5b1b-5567-a541-4a05c052fbcf
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_d034196faebe268f29fc39a14d2e0cd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_d034196faebe268f29fc39a14d2e0cd4.jpg not downloaded yet
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_75b01a1491f515af4c597610f6d878d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_75b01a1491f515af4c597610f6d878d8.jpg not downloaded yet
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_74ebe4ab70ab1629f0613a775bf5da74.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d2df10>
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_2e4ad2fd318f95fd7acc825453ffceb1.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_2e4ad2fd318f95fd7acc825453ffceb1.jpg saved to cache
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_6fa2a952d83662f3e9e77ef94152d6a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_6fa2a952d83662f3e9e77ef94152d6a0.jpg not downloaded yet
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_c9a8f73a4280e1a4027ec6f96cb668e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_c9a8f73a4280e1a4027ec6f96cb668e6.jpg not downloaded yet
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_70ba10036aca184112c283815f7013c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_2d88d2bed894352ac8be3bd8e1e22f40.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_2d88d2bed894352ac8be3bd8e1e22f40.jpg not downloaded yet
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_48f238fc38a8ef065481f0b6833ebca2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_5b7da517b73c5809cb34c28ae0f26023.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_5b7da517b73c5809cb34c28ae0f26023.jpg not downloaded yet
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_837ba45ef554ce5a19e7e896552433cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_837ba45ef554ce5a19e7e896552433cf.jpg not downloaded yet
2026-03-30 09:00:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d41010>
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_74ebe4ab70ab1629f0613a775bf5da74.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_74ebe4ab70ab1629f0613a775bf5da74.jpg saved to cache
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e683f7b-8d5a-5801-a492-40c117477db5
2026-03-30 09:00:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ca5150>
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_70ba10036aca184112c283815f7013c9.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_70ba10036aca184112c283815f7013c9.jpg saved to cache
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e683f7b-8d5a-5801-a492-40c117477db5
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d2e450>
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_48f238fc38a8ef065481f0b6833ebca2.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_48f238fc38a8ef065481f0b6833ebca2.jpg saved to cache
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_28840b2787f8712ecb73a3c67f66294f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_23ce1989f8885f04a1524e895cc5b996.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_c55c3170c25ba67c44be7841affd63a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_03fa79b5305ff5be92aeae43c5ed932e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_912e25b6193e0be8b403fdff1c88a729.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_f7e2d590ff1e81574e26b46a3376fa0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_43db56bdbe123cbe29e5911b5f1bba6e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_6e69137f49c8388b2dc9be2c074fbded.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_822bbada0c7e8e205d5c1c8cfea442c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_d034196faebe268f29fc39a14d2e0cd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_c9a8f73a4280e1a4027ec6f96cb668e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_2d88d2bed894352ac8be3bd8e1e22f40.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_837ba45ef554ce5a19e7e896552433cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_5b7da517b73c5809cb34c28ae0f26023.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_805b2ed0146f7fa621f22d41949d3283.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ce2d10>
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_28840b2787f8712ecb73a3c67f66294f.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_28840b2787f8712ecb73a3c67f66294f.jpg saved to cache
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6b20f6b-26a6-5f46-b121-129c6ecea859
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063b52d0>
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_23ce1989f8885f04a1524e895cc5b996.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_23ce1989f8885f04a1524e895cc5b996.jpg saved to cache
2026-03-30 09:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6b20f6b-26a6-5f46-b121-129c6ecea859
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_b11b55c62461b7866a14cb5a69c94253.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_c836ade35d2666081158c28b39788ea9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_6fa2a952d83662f3e9e77ef94152d6a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e5f210>
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_c55c3170c25ba67c44be7841affd63a8.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_c55c3170c25ba67c44be7841affd63a8.jpg saved to cache
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb0385cc-6131-561a-a274-20d15f45e9cf
2026-03-30 09:00:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062aeb50>
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_03fa79b5305ff5be92aeae43c5ed932e.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_03fa79b5305ff5be92aeae43c5ed932e.jpg saved to cache
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb0385cc-6131-561a-a274-20d15f45e9cf
2026-03-30 09:00:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062be7d0>
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_912e25b6193e0be8b403fdff1c88a729.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_912e25b6193e0be8b403fdff1c88a729.jpg saved to cache
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb0385cc-6131-561a-a274-20d15f45e9cf
2026-03-30 09:00:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062bc1d0>
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_f7e2d590ff1e81574e26b46a3376fa0a.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_f7e2d590ff1e81574e26b46a3376fa0a.jpg saved to cache
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb0385cc-6131-561a-a274-20d15f45e9cf
2026-03-30 09:00:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062a2d50>
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_43db56bdbe123cbe29e5911b5f1bba6e.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_43db56bdbe123cbe29e5911b5f1bba6e.jpg saved to cache
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb0385cc-6131-561a-a274-20d15f45e9cf
2026-03-30 09:00:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062b0a50>
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_6e69137f49c8388b2dc9be2c074fbded.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_6e69137f49c8388b2dc9be2c074fbded.jpg saved to cache
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb0385cc-6131-561a-a274-20d15f45e9cf
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062bf210>
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_822bbada0c7e8e205d5c1c8cfea442c4.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_822bbada0c7e8e205d5c1c8cfea442c4.jpg saved to cache
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6b20f6b-26a6-5f46-b121-129c6ecea859
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062c5090>
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_d034196faebe268f29fc39a14d2e0cd4.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_d034196faebe268f29fc39a14d2e0cd4.jpg saved to cache
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b166d30-4359-56fc-b2e7-53db2f3acff7
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c94b10>
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_c9a8f73a4280e1a4027ec6f96cb668e6.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_c9a8f73a4280e1a4027ec6f96cb668e6.jpg saved to cache
2026-03-30 09:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b166d30-4359-56fc-b2e7-53db2f3acff7
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062c86d0>
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_2d88d2bed894352ac8be3bd8e1e22f40.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_2d88d2bed894352ac8be3bd8e1e22f40.jpg saved to cache
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b166d30-4359-56fc-b2e7-53db2f3acff7
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cbda90>
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_837ba45ef554ce5a19e7e896552433cf.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_837ba45ef554ce5a19e7e896552433cf.jpg saved to cache
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b166d30-4359-56fc-b2e7-53db2f3acff7
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062c9750>
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_5b7da517b73c5809cb34c28ae0f26023.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_5b7da517b73c5809cb34c28ae0f26023.jpg saved to cache
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b166d30-4359-56fc-b2e7-53db2f3acff7
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062ac790>
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_805b2ed0146f7fa621f22d41949d3283.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_805b2ed0146f7fa621f22d41949d3283.jpg saved to cache
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b166d30-4359-56fc-b2e7-53db2f3acff7
2026-03-30 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_c958af0c1ecf0e87612b4ea152447802.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d5aa10>
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_b11b55c62461b7866a14cb5a69c94253.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_b11b55c62461b7866a14cb5a69c94253.jpg saved to cache
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6b20f6b-26a6-5f46-b121-129c6ecea859
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d5b550>
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_c836ade35d2666081158c28b39788ea9.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_c836ade35d2666081158c28b39788ea9.jpg saved to cache
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6b20f6b-26a6-5f46-b121-129c6ecea859
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fa4fd0>
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_6fa2a952d83662f3e9e77ef94152d6a0.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_6fa2a952d83662f3e9e77ef94152d6a0.jpg saved to cache
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b166d30-4359-56fc-b2e7-53db2f3acff7
2026-03-30 09:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062755d0>
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_c958af0c1ecf0e87612b4ea152447802.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_c958af0c1ecf0e87612b4ea152447802.jpg saved to cache
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6b20f6b-26a6-5f46-b121-129c6ecea859
2026-03-30 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_c30c90d997bc757995c5a6ac0167ea8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_75b01a1491f515af4c597610f6d878d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_f9a36618f288f0048784baa7c84a99db.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_63c2890e2cefb9dfdea0aa2aa0c89065.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_f9561af0063cf8c53098f61f8dd92897.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_71db162a3e463962bcef2a7f123241aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_84af2384d539a6284818fd43258402c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_5884a63b328f5762bcf530a68180ff9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0627ffd0>
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_c30c90d997bc757995c5a6ac0167ea8f.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_c30c90d997bc757995c5a6ac0167ea8f.jpg saved to cache
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d
2026-03-30 09:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_b65569fd93b3aca453277288da222154.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062c6fd0>
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_75b01a1491f515af4c597610f6d878d8.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_75b01a1491f515af4c597610f6d878d8.jpg saved to cache
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b166d30-4359-56fc-b2e7-53db2f3acff7
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06203990>
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_f9a36618f288f0048784baa7c84a99db.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_f9a36618f288f0048784baa7c84a99db.jpg saved to cache
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b166d30-4359-56fc-b2e7-53db2f3acff7
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f63210>
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F23%252F7123554d6b2f4d23dd467f0b265cd956%252Fpa%252FTM12989_63c2890e2cefb9dfdea0aa2aa0c89065.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_63c2890e2cefb9dfdea0aa2aa0c89065.jpg saved to cache
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b166d30-4359-56fc-b2e7-53db2f3acff7
2026-03-30 09:00:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b166d30-4359-56fc-b2e7-53db2f3acff7, skipping ID generation
2026-03-30 09:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b166d30-4359-56fc-b2e7-53db2f3acff7 with scrape type 1
2026-03-30 09:00:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b166d30-4359-56fc-b2e7-53db2f3acff7 sending to next pipeline
2026-03-30 09:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8b166d30-4359-56fc-b2e7-53db2f3acff7, identifier: TM12989
2026-03-30 09:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_77755652f6ae6e353ecad0ea327d434a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8b166d30-4359-56fc-b2e7-53db2f3acff7 with identifier: TM12989
2026-03-30 09:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8b166d30-4359-56fc-b2e7-53db2f3acff7 with identifier: TM12989
2026-03-30 09:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8b166d30-4359-56fc-b2e7-53db2f3acff7 with identifier: TM12989 to the API
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_63c2890e2cefb9dfdea0aa2aa0c89065.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:55:32Z',
 'fuel_type': 'diesel',
 'id': '8b166d30-4359-56fc-b2e7-53db2f3acff7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM12989',
 'listing': 'auction',
 'location': 'IT, Pompei',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 13392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_805b2ed0146f7fa621f22d41949d3283.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_63c2890e2cefb9dfdea0aa2aa0c89065.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_f9a36618f288f0048784baa7c84a99db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_d034196faebe268f29fc39a14d2e0cd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_75b01a1491f515af4c597610f6d878d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_6fa2a952d83662f3e9e77ef94152d6a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_c9a8f73a4280e1a4027ec6f96cb668e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_2d88d2bed894352ac8be3bd8e1e22f40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_5b7da517b73c5809cb34c28ae0f26023.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b166d30-4359-56fc-b2e7-53db2f3acff7/8b166d30-4359-56fc-b2e7-53db2f3acff7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/23/7123554d6b2f4d23dd467f0b265cd956/pa/TM12989_837ba45ef554ce5a19e7e896552433cf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2024}
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM12989%27 HTTP/1.1" 200 None
2026-03-30 09:00:41 [auto1.it] INFO: Saving data for TM12989: {'created_time': 1774861241.687585, 'last_price_update_time': 1774861241.687594, 'auction_closing_time': 1774972532.0}
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TM12989') HTTP/1.1" 204 0
2026-03-30 09:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_90dcbcf0314019ccfdab645318a3dfce.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d83250>
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_f9561af0063cf8c53098f61f8dd92897.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_f9561af0063cf8c53098f61f8dd92897.jpg saved to cache
2026-03-30 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d
2026-03-30 09:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0622c550>
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_71db162a3e463962bcef2a7f123241aa.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_71db162a3e463962bcef2a7f123241aa.jpg saved to cache
2026-03-30 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb0385cc-6131-561a-a274-20d15f45e9cf
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062ca250>
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_84af2384d539a6284818fd43258402c1.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_84af2384d539a6284818fd43258402c1.jpg saved to cache
2026-03-30 09:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6b20f6b-26a6-5f46-b121-129c6ecea859
2026-03-30 09:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d9e910>
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_5884a63b328f5762bcf530a68180ff9d.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_5884a63b328f5762bcf530a68180ff9d.jpg saved to cache
2026-03-30 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb0385cc-6131-561a-a274-20d15f45e9cf
2026-03-30 09:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e10590>
2026-03-30 09:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F5d%252F3c5d81c61935cd2539c4a69ef4f91adb%252Fpa%252FXU90794_b65569fd93b3aca453277288da222154.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_b65569fd93b3aca453277288da222154.jpg saved to cache
2026-03-30 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d
2026-03-30 09:00:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d, skipping ID generation
2026-03-30 09:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d with scrape type 1
2026-03-30 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d sending to next pipeline
2026-03-30 09:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d, identifier: XU90794
2026-03-30 09:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0638a2d0>
2026-03-30 09:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_77755652f6ae6e353ecad0ea327d434a.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_77755652f6ae6e353ecad0ea327d434a.jpg saved to cache
2026-03-30 09:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6b20f6b-26a6-5f46-b121-129c6ecea859
2026-03-30 09:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d with identifier: XU90794
2026-03-30 09:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d with identifier: XU90794
2026-03-30 09:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d with identifier: XU90794 to the API
2026-03-30 09:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_b65569fd93b3aca453277288da222154.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:19:38Z',
 'fuel_type': 'diesel',
 'id': 'b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU90794',
 'listing': 'auction',
 'location': 'IT, Venezia',
 'make': 'BMW',
 'model': '3er',
 'odometer': 213919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_b65569fd93b3aca453277288da222154.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_f9561af0063cf8c53098f61f8dd92897.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_c30c90d997bc757995c5a6ac0167ea8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_48f238fc38a8ef065481f0b6833ebca2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_e2d2ed856844165cbdcd0ac4ec3ae476.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_2e4ad2fd318f95fd7acc825453ffceb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_32d8f299d0f123822d99396f38ad7a6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_21c89148f7523a09de3b6d15d379f067.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_9d2a77e48acb3a3d3ccf3e82944c2b0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d/b4a474c2-56bf-5f3d-a8e1-f23ab31eee4d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/5d/3c5d81c61935cd2539c4a69ef4f91adb/pa/XU90794_db892e68fc3337878fa3cc46c6e14766.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 316d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU90794%27 HTTP/1.1" 200 None
2026-03-30 09:00:43 [auto1.it] INFO: Saving data for XU90794: {'created_time': 1774861243.163645, 'last_price_update_time': 1774861243.163657, 'auction_closing_time': 1774970378.0}
2026-03-30 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XU90794') HTTP/1.1" 204 0
2026-03-30 09:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV86242> (referer: https://www.auto1.com/v1/car-details-view/VV86242/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP95163> (referer: https://www.auto1.com/v1/car-details-view/BP95163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06203610>
2026-03-30 09:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fc8%252F32c89c4339dc4656d525be28234f65db%252Fpa%252FGS61581_90dcbcf0314019ccfdab645318a3dfce.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_90dcbcf0314019ccfdab645318a3dfce.jpg saved to cache
2026-03-30 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6b20f6b-26a6-5f46-b121-129c6ecea859
2026-03-30 09:00:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6b20f6b-26a6-5f46-b121-129c6ecea859, skipping ID generation
2026-03-30 09:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b20f6b-26a6-5f46-b121-129c6ecea859 with scrape type 1
2026-03-30 09:00:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6b20f6b-26a6-5f46-b121-129c6ecea859 sending to next pipeline
2026-03-30 09:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f6b20f6b-26a6-5f46-b121-129c6ecea859, identifier: GS61581
2026-03-30 09:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f6b20f6b-26a6-5f46-b121-129c6ecea859 with identifier: GS61581
2026-03-30 09:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f6b20f6b-26a6-5f46-b121-129c6ecea859 with identifier: GS61581
2026-03-30 09:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f6b20f6b-26a6-5f46-b121-129c6ecea859 with identifier: GS61581 to the API
2026-03-30 09:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_90dcbcf0314019ccfdab645318a3dfce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:19:06Z',
 'fuel_type': 'diesel',
 'id': 'f6b20f6b-26a6-5f46-b121-129c6ecea859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS61581',
 'listing': 'auction',
 'location': 'IT, Navacchio',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 141750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_85e1b3b6b0cb4230277064c1006213f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_23ce1989f8885f04a1524e895cc5b996.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_822bbada0c7e8e205d5c1c8cfea442c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_28840b2787f8712ecb73a3c67f66294f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_b11b55c62461b7866a14cb5a69c94253.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_c836ade35d2666081158c28b39788ea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_c958af0c1ecf0e87612b4ea152447802.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_90dcbcf0314019ccfdab645318a3dfce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_84af2384d539a6284818fd43258402c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b20f6b-26a6-5f46-b121-129c6ecea859/f6b20f6b-26a6-5f46-b121-129c6ecea859_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/c8/32c89c4339dc4656d525be28234f65db/pa/GS61581_77755652f6ae6e353ecad0ea327d434a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2018}
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS61581%27 HTTP/1.1" 200 None
2026-03-30 09:00:45 [auto1.it] INFO: Saving data for GS61581: {'created_time': 1774861245.146206, 'last_price_update_time': 1774861245.146215, 'auction_closing_time': 1774970346.0}
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GS61581') HTTP/1.1" 204 0
2026-03-30 09:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afec461a-98a5-5cc6-af96-194396e9a31b with identifier: VV86242
2026-03-30 09:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afec461a-98a5-5cc6-af96-194396e9a31b with scrape type 1
2026-03-30 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item afec461a-98a5-5cc6-af96-194396e9a31b
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb3%252F89b329d2f0297ab1e5d304f09f6dad57%252Fpa%252FVV86242_9ab6bcfe21dadfebd45a1522f3d3396a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_9ab6bcfe21dadfebd45a1522f3d3396a.jpg already downloaded
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb3%252F89b329d2f0297ab1e5d304f09f6dad57%252Fpa%252FVV86242_fa5e0d92ac8ef3811275fa6f1fafcecb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_fa5e0d92ac8ef3811275fa6f1fafcecb.jpg already downloaded
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb3%252F89b329d2f0297ab1e5d304f09f6dad57%252Fpa%252FVV86242_a4c42574d1eec274227eb41dbf8cccca.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_a4c42574d1eec274227eb41dbf8cccca.jpg already downloaded
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb3%252F89b329d2f0297ab1e5d304f09f6dad57%252Fpa%252FVV86242_1bda9cd2a631aeaebe83a31981fa0725.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_1bda9cd2a631aeaebe83a31981fa0725.jpg already downloaded
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb3%252F89b329d2f0297ab1e5d304f09f6dad57%252Fpa%252FVV86242_f4086c6a8b4d4f4b05b1cbc7cb815b6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_f4086c6a8b4d4f4b05b1cbc7cb815b6d.jpg already downloaded
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb3%252F89b329d2f0297ab1e5d304f09f6dad57%252Fpa%252FVV86242_2269ba3de4096315553d1ef4841d3c24.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_2269ba3de4096315553d1ef4841d3c24.jpg already downloaded
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb3%252F89b329d2f0297ab1e5d304f09f6dad57%252Fpa%252FVV86242_d749dd14183260dfcf0d3618b118dbc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_d749dd14183260dfcf0d3618b118dbc7.jpg already downloaded
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb3%252F89b329d2f0297ab1e5d304f09f6dad57%252Fpa%252FVV86242_96f13601dfd8a9a875f3ea704fe93ffd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_96f13601dfd8a9a875f3ea704fe93ffd.jpg already downloaded
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb3%252F89b329d2f0297ab1e5d304f09f6dad57%252Fpa%252FVV86242_b2110db05ac43f2ee375c2b21e49d94a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_b2110db05ac43f2ee375c2b21e49d94a.jpg already downloaded
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb3%252F89b329d2f0297ab1e5d304f09f6dad57%252Fpa%252FVV86242_8f75e2022af3fcc2b80ff8e6fa3d05fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_8f75e2022af3fcc2b80ff8e6fa3d05fc.jpg already downloaded
2026-03-30 09:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: afec461a-98a5-5cc6-af96-194396e9a31b, identifier: VV86242
2026-03-30 09:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fff3f5f-6d63-5c0e-8b10-60e622cd5609 with identifier: BP95163
2026-03-30 09:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fff3f5f-6d63-5c0e-8b10-60e622cd5609 with scrape type 1
2026-03-30 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9fff3f5f-6d63-5c0e-8b10-60e622cd5609
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb6%252F5cb63925f3bd2ff761effd66de1a542c%252Fpa%252FBP95163_90f80f9eb9445059db469f91db7cca1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_90f80f9eb9445059db469f91db7cca1d.jpg not downloaded yet
2026-03-30 09:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: afec461a-98a5-5cc6-af96-194396e9a31b with identifier: VV86242
2026-03-30 09:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: afec461a-98a5-5cc6-af96-194396e9a31b with identifier: VV86242
2026-03-30 09:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: afec461a-98a5-5cc6-af96-194396e9a31b with identifier: VV86242 to the API
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VV86242>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:56:25Z',
 'fuel_type': 'petrol',
 'id': 'afec461a-98a5-5cc6-af96-194396e9a31b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV86242',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 150850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_9ab6bcfe21dadfebd45a1522f3d3396a.jpg',
                'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_fa5e0d92ac8ef3811275fa6f1fafcecb.jpg',
                'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_a4c42574d1eec274227eb41dbf8cccca.jpg',
                'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_1bda9cd2a631aeaebe83a31981fa0725.jpg',
                'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_f4086c6a8b4d4f4b05b1cbc7cb815b6d.jpg',
                'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_2269ba3de4096315553d1ef4841d3c24.jpg',
                'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_d749dd14183260dfcf0d3618b118dbc7.jpg',
                'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_96f13601dfd8a9a875f3ea704fe93ffd.jpg',
                'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_b2110db05ac43f2ee375c2b21e49d94a.jpg',
                'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_8f75e2022af3fcc2b80ff8e6fa3d05fc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afec461a-98a5-5cc6-af96-194396e9a31b/afec461a-98a5-5cc6-af96-194396e9a31b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3415589,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_9ab6bcfe21dadfebd45a1522f3d3396a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afec461a-98a5-5cc6-af96-194396e9a31b/afec461a-98a5-5cc6-af96-194396e9a31b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3321614,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_fa5e0d92ac8ef3811275fa6f1fafcecb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afec461a-98a5-5cc6-af96-194396e9a31b/afec461a-98a5-5cc6-af96-194396e9a31b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_a4c42574d1eec274227eb41dbf8cccca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afec461a-98a5-5cc6-af96-194396e9a31b/afec461a-98a5-5cc6-af96-194396e9a31b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_1bda9cd2a631aeaebe83a31981fa0725.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afec461a-98a5-5cc6-af96-194396e9a31b/afec461a-98a5-5cc6-af96-194396e9a31b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3147756,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_f4086c6a8b4d4f4b05b1cbc7cb815b6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afec461a-98a5-5cc6-af96-194396e9a31b/afec461a-98a5-5cc6-af96-194396e9a31b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3330089,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_2269ba3de4096315553d1ef4841d3c24.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afec461a-98a5-5cc6-af96-194396e9a31b/afec461a-98a5-5cc6-af96-194396e9a31b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3262767,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_d749dd14183260dfcf0d3618b118dbc7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afec461a-98a5-5cc6-af96-194396e9a31b/afec461a-98a5-5cc6-af96-194396e9a31b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_96f13601dfd8a9a875f3ea704fe93ffd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afec461a-98a5-5cc6-af96-194396e9a31b/afec461a-98a5-5cc6-af96-194396e9a31b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_b2110db05ac43f2ee375c2b21e49d94a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afec461a-98a5-5cc6-af96-194396e9a31b/afec461a-98a5-5cc6-af96-194396e9a31b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3237182,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b3/89b329d2f0297ab1e5d304f09f6dad57/pa/VV86242_8f75e2022af3fcc2b80ff8e6fa3d05fc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Silver',
 'transmission': 'manual',
 'trim': 'Silver',
 'year': 2017}
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV86242%27 HTTP/1.1" 200 None
2026-03-30 09:00:46 [auto1.it] INFO: Saving data for VV86242: {'created_time': 1774861246.147424, 'last_price_update_time': 1774861246.147435, 'auction_closing_time': 1774972585.0}
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VV86242') HTTP/1.1" 204 0
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb6%252F5cb63925f3bd2ff761effd66de1a542c%252Fpa%252FBP95163_e032e4260237511d0e4e9eb8abb73e0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_e032e4260237511d0e4e9eb8abb73e0a.jpg not downloaded yet
2026-03-30 09:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_a7d8c25492614c0e8271bc3617bb4352.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_5954c141cc5b0d921467113c1ae320d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb6%252F5cb63925f3bd2ff761effd66de1a542c%252Fpa%252FBP95163_83047b00772c111e0cfb2cb553643f07.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_83047b00772c111e0cfb2cb553643f07.jpg not downloaded yet
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb6%252F5cb63925f3bd2ff761effd66de1a542c%252Fpa%252FBP95163_99f1cb41606b0ad28c7324df0a57459d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_99f1cb41606b0ad28c7324df0a57459d.jpg not downloaded yet
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb6%252F5cb63925f3bd2ff761effd66de1a542c%252Fpa%252FBP95163_1a2220009eebda177ac5604667d69751.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_1a2220009eebda177ac5604667d69751.jpg not downloaded yet
2026-03-30 09:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_81bcf3f58dfa648fe2d82c26198c0b58.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_522d9fa79ce8fd6fc5cdf8baa51f752f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_323fa0c91ca75213675339b4a7e43422.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_769050e98159c99394f33435c92d151e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_d61f7ec7ef3a46c524b7f3209e547772.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f61590>
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_a7d8c25492614c0e8271bc3617bb4352.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_a7d8c25492614c0e8271bc3617bb4352.jpg saved to cache
2026-03-30 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e683f7b-8d5a-5801-a492-40c117477db5
2026-03-30 09:00:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06200310>
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_5954c141cc5b0d921467113c1ae320d8.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_5954c141cc5b0d921467113c1ae320d8.jpg saved to cache
2026-03-30 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb0385cc-6131-561a-a274-20d15f45e9cf
2026-03-30 09:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_bdd74369af11fd519e5b65849ba63b2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_1217b5636ebf22d5cd595484741dad17.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c1b690>
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_81bcf3f58dfa648fe2d82c26198c0b58.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_81bcf3f58dfa648fe2d82c26198c0b58.jpg saved to cache
2026-03-30 09:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a042620-5b1b-5567-a541-4a05c052fbcf
2026-03-30 09:00:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d5bd50>
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_522d9fa79ce8fd6fc5cdf8baa51f752f.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_522d9fa79ce8fd6fc5cdf8baa51f752f.jpg saved to cache
2026-03-30 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e683f7b-8d5a-5801-a492-40c117477db5
2026-03-30 09:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062c9710>
2026-03-30 09:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_323fa0c91ca75213675339b4a7e43422.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_323fa0c91ca75213675339b4a7e43422.jpg saved to cache
2026-03-30 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e683f7b-8d5a-5801-a492-40c117477db5
2026-03-30 09:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0638bcd0>
2026-03-30 09:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd6%252Ff9d695d03713b3e87701bf66ac75acfd%252Fpa%252FER70142_769050e98159c99394f33435c92d151e.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_769050e98159c99394f33435c92d151e.jpg saved to cache
2026-03-30 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb0385cc-6131-561a-a274-20d15f45e9cf
2026-03-30 09:00:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb0385cc-6131-561a-a274-20d15f45e9cf, skipping ID generation
2026-03-30 09:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb0385cc-6131-561a-a274-20d15f45e9cf with scrape type 1
2026-03-30 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb0385cc-6131-561a-a274-20d15f45e9cf sending to next pipeline
2026-03-30 09:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb0385cc-6131-561a-a274-20d15f45e9cf, identifier: ER70142
2026-03-30 09:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f26410>
2026-03-30 09:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_d61f7ec7ef3a46c524b7f3209e547772.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_d61f7ec7ef3a46c524b7f3209e547772.jpg saved to cache
2026-03-30 09:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a042620-5b1b-5567-a541-4a05c052fbcf
2026-03-30 09:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb0385cc-6131-561a-a274-20d15f45e9cf with identifier: ER70142
2026-03-30 09:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb0385cc-6131-561a-a274-20d15f45e9cf with identifier: ER70142
2026-03-30 09:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb0385cc-6131-561a-a274-20d15f45e9cf with identifier: ER70142 to the API
2026-03-30 09:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_769050e98159c99394f33435c92d151e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:58:30Z',
 'fuel_type': 'petrol',
 'id': 'fb0385cc-6131-561a-a274-20d15f45e9cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER70142',
 'listing': 'auction',
 'location': 'IT, Livorno',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 68550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2675900,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_769050e98159c99394f33435c92d151e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2670112,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_5954c141cc5b0d921467113c1ae320d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2697689,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_5884a63b328f5762bcf530a68180ff9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793583,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_71db162a3e463962bcef2a7f123241aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2704360,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_43db56bdbe123cbe29e5911b5f1bba6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2786041,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_6e69137f49c8388b2dc9be2c074fbded.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2815493,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_f7e2d590ff1e81574e26b46a3376fa0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2639267,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_912e25b6193e0be8b403fdff1c88a729.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2597465,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_03fa79b5305ff5be92aeae43c5ed932e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb0385cc-6131-561a-a274-20d15f45e9cf/fb0385cc-6131-561a-a274-20d15f45e9cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2847651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d6/f9d695d03713b3e87701bf66ac75acfd/pa/ER70142_c55c3170c25ba67c44be7841affd63a8.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER70142%27 HTTP/1.1" 200 None
2026-03-30 09:00:48 [auto1.it] INFO: Saving data for ER70142: {'created_time': 1774861248.354269, 'last_price_update_time': 1774861248.354282, 'auction_closing_time': 1774972710.0}
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ER70142') HTTP/1.1" 204 0
2026-03-30 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_198af5b69f1360eea9561f1731985b2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_e032e4260237511d0e4e9eb8abb73e0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e47210>
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c73803d-d5dc-5bdb-aadc-cbe2741945a8/9c73803d-d5dc-5bdb-aadc-cbe2741945a8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F6d%252Fdb6d37b96c082f3b75e15ffd48e14339%252Fpa%252FWL93075_bdd74369af11fd519e5b65849ba63b2d.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_bdd74369af11fd519e5b65849ba63b2d.jpg saved to cache
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c73803d-d5dc-5bdb-aadc-cbe2741945a8
2026-03-30 09:00:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0622b390>
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_1217b5636ebf22d5cd595484741dad17.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_1217b5636ebf22d5cd595484741dad17.jpg saved to cache
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a042620-5b1b-5567-a541-4a05c052fbcf
2026-03-30 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_90f80f9eb9445059db469f91db7cca1d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d94250>
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c73803d-d5dc-5bdb-aadc-cbe2741945a8/9c73803d-d5dc-5bdb-aadc-cbe2741945a8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F6d%252Fdb6d37b96c082f3b75e15ffd48e14339%252Fpa%252FWL93075_198af5b69f1360eea9561f1731985b2d.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_198af5b69f1360eea9561f1731985b2d.jpg saved to cache
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c73803d-d5dc-5bdb-aadc-cbe2741945a8
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062c9710>
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fff3f5f-6d63-5c0e-8b10-60e622cd5609/9fff3f5f-6d63-5c0e-8b10-60e622cd5609_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb6%252F5cb63925f3bd2ff761effd66de1a542c%252Fpa%252FBP95163_e032e4260237511d0e4e9eb8abb73e0a.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_e032e4260237511d0e4e9eb8abb73e0a.jpg saved to cache
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9fff3f5f-6d63-5c0e-8b10-60e622cd5609
2026-03-30 09:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_1a2220009eebda177ac5604667d69751.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062301d0>
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fff3f5f-6d63-5c0e-8b10-60e622cd5609/9fff3f5f-6d63-5c0e-8b10-60e622cd5609_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb6%252F5cb63925f3bd2ff761effd66de1a542c%252Fpa%252FBP95163_90f80f9eb9445059db469f91db7cca1d.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_90f80f9eb9445059db469f91db7cca1d.jpg saved to cache
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fff3f5f-6d63-5c0e-8b10-60e622cd5609
2026-03-30 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_83047b00772c111e0cfb2cb553643f07.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_99f1cb41606b0ad28c7324df0a57459d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_f0e6b697dbdf3198bfc476e6f7e6af5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_8a792d12f5571a80749dc5fb97d99bd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_628b0f68c0eb7aa050f5d8bca7eff382.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_eadd2198f644342ae86db578ebae427d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_845eeb8d458df6c34e8913ae81f6195f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_9f2dd9af5fec890f2be39e8b3cda2d15.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ec6490>
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fff3f5f-6d63-5c0e-8b10-60e622cd5609/9fff3f5f-6d63-5c0e-8b10-60e622cd5609_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb6%252F5cb63925f3bd2ff761effd66de1a542c%252Fpa%252FBP95163_1a2220009eebda177ac5604667d69751.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_1a2220009eebda177ac5604667d69751.jpg saved to cache
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9fff3f5f-6d63-5c0e-8b10-60e622cd5609
2026-03-30 09:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_d1efd91e92925e8e58d1f89fa5b523d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0627de10>
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fff3f5f-6d63-5c0e-8b10-60e622cd5609/9fff3f5f-6d63-5c0e-8b10-60e622cd5609_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb6%252F5cb63925f3bd2ff761effd66de1a542c%252Fpa%252FBP95163_83047b00772c111e0cfb2cb553643f07.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_83047b00772c111e0cfb2cb553643f07.jpg saved to cache
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9fff3f5f-6d63-5c0e-8b10-60e622cd5609
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0638b450>
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fff3f5f-6d63-5c0e-8b10-60e622cd5609/9fff3f5f-6d63-5c0e-8b10-60e622cd5609_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb6%252F5cb63925f3bd2ff761effd66de1a542c%252Fpa%252FBP95163_99f1cb41606b0ad28c7324df0a57459d.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_99f1cb41606b0ad28c7324df0a57459d.jpg saved to cache
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9fff3f5f-6d63-5c0e-8b10-60e622cd5609
2026-03-30 09:00:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9fff3f5f-6d63-5c0e-8b10-60e622cd5609, skipping ID generation
2026-03-30 09:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fff3f5f-6d63-5c0e-8b10-60e622cd5609 with scrape type 1
2026-03-30 09:00:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fff3f5f-6d63-5c0e-8b10-60e622cd5609 sending to next pipeline
2026-03-30 09:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9fff3f5f-6d63-5c0e-8b10-60e622cd5609, identifier: BP95163
2026-03-30 09:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9fff3f5f-6d63-5c0e-8b10-60e622cd5609 with identifier: BP95163
2026-03-30 09:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9fff3f5f-6d63-5c0e-8b10-60e622cd5609 with identifier: BP95163
2026-03-30 09:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9fff3f5f-6d63-5c0e-8b10-60e622cd5609 with identifier: BP95163 to the API
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_99f1cb41606b0ad28c7324df0a57459d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:50:25Z',
 'fuel_type': 'diesel',
 'id': '9fff3f5f-6d63-5c0e-8b10-60e622cd5609',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP95163',
 'listing': 'auction',
 'location': 'IT, Avezzano',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 331485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fff3f5f-6d63-5c0e-8b10-60e622cd5609/9fff3f5f-6d63-5c0e-8b10-60e622cd5609_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_90f80f9eb9445059db469f91db7cca1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fff3f5f-6d63-5c0e-8b10-60e622cd5609/9fff3f5f-6d63-5c0e-8b10-60e622cd5609_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_e032e4260237511d0e4e9eb8abb73e0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fff3f5f-6d63-5c0e-8b10-60e622cd5609/9fff3f5f-6d63-5c0e-8b10-60e622cd5609_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_83047b00772c111e0cfb2cb553643f07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fff3f5f-6d63-5c0e-8b10-60e622cd5609/9fff3f5f-6d63-5c0e-8b10-60e622cd5609_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_99f1cb41606b0ad28c7324df0a57459d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fff3f5f-6d63-5c0e-8b10-60e622cd5609/9fff3f5f-6d63-5c0e-8b10-60e622cd5609_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b6/5cb63925f3bd2ff761effd66de1a542c/pa/BP95163_1a2220009eebda177ac5604667d69751.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP95163%27 HTTP/1.1" 200 None
2026-03-30 09:00:49 [auto1.it] INFO: Saving data for BP95163: {'created_time': 1774861249.528833, 'last_price_update_time': 1774861249.528878, 'auction_closing_time': 1774972225.0}
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BP95163') HTTP/1.1" 204 0
2026-03-30 09:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_58f8127bcb7c07695ade871aa16a83fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_9a1dfff1f58cf6fc8af041503e24c141.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06249490>
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_f0e6b697dbdf3198bfc476e6f7e6af5f.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_f0e6b697dbdf3198bfc476e6f7e6af5f.jpg saved to cache
2026-03-30 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e683f7b-8d5a-5801-a492-40c117477db5
2026-03-30 09:00:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c34a90>
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_8a792d12f5571a80749dc5fb97d99bd4.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_8a792d12f5571a80749dc5fb97d99bd4.jpg saved to cache
2026-03-30 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e683f7b-8d5a-5801-a492-40c117477db5
2026-03-30 09:00:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f73dd0>
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_628b0f68c0eb7aa050f5d8bca7eff382.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_628b0f68c0eb7aa050f5d8bca7eff382.jpg saved to cache
2026-03-30 09:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a042620-5b1b-5567-a541-4a05c052fbcf
2026-03-30 09:00:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c34c10>
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_eadd2198f644342ae86db578ebae427d.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_eadd2198f644342ae86db578ebae427d.jpg saved to cache
2026-03-30 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a042620-5b1b-5567-a541-4a05c052fbcf
2026-03-30 09:00:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd5950>
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_845eeb8d458df6c34e8913ae81f6195f.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_845eeb8d458df6c34e8913ae81f6195f.jpg saved to cache
2026-03-30 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a042620-5b1b-5567-a541-4a05c052fbcf
2026-03-30 09:00:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c36c90>
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_9f2dd9af5fec890f2be39e8b3cda2d15.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_9f2dd9af5fec890f2be39e8b3cda2d15.jpg saved to cache
2026-03-30 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a042620-5b1b-5567-a541-4a05c052fbcf
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e7a4d0>
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c73803d-d5dc-5bdb-aadc-cbe2741945a8/9c73803d-d5dc-5bdb-aadc-cbe2741945a8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F6d%252Fdb6d37b96c082f3b75e15ffd48e14339%252Fpa%252FWL93075_d1efd91e92925e8e58d1f89fa5b523d7.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_d1efd91e92925e8e58d1f89fa5b523d7.jpg saved to cache
2026-03-30 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c73803d-d5dc-5bdb-aadc-cbe2741945a8
2026-03-30 09:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_7a6304ffdce47e6fc6a183fb19d1f6b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dc7210>
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_58f8127bcb7c07695ade871aa16a83fe.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_58f8127bcb7c07695ade871aa16a83fe.jpg saved to cache
2026-03-30 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6ccda8f-82b6-5052-b931-82cd4e0addec
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c28090>
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c73803d-d5dc-5bdb-aadc-cbe2741945a8/9c73803d-d5dc-5bdb-aadc-cbe2741945a8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F6d%252Fdb6d37b96c082f3b75e15ffd48e14339%252Fpa%252FWL93075_9a1dfff1f58cf6fc8af041503e24c141.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_9a1dfff1f58cf6fc8af041503e24c141.jpg saved to cache
2026-03-30 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c73803d-d5dc-5bdb-aadc-cbe2741945a8
2026-03-30 09:00:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c73803d-d5dc-5bdb-aadc-cbe2741945a8, skipping ID generation
2026-03-30 09:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c73803d-d5dc-5bdb-aadc-cbe2741945a8 with scrape type 1
2026-03-30 09:00:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c73803d-d5dc-5bdb-aadc-cbe2741945a8 sending to next pipeline
2026-03-30 09:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9c73803d-d5dc-5bdb-aadc-cbe2741945a8, identifier: WL93075
2026-03-30 09:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9c73803d-d5dc-5bdb-aadc-cbe2741945a8 with identifier: WL93075
2026-03-30 09:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9c73803d-d5dc-5bdb-aadc-cbe2741945a8 with identifier: WL93075
2026-03-30 09:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9c73803d-d5dc-5bdb-aadc-cbe2741945a8 with identifier: WL93075 to the API
2026-03-30 09:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_9a1dfff1f58cf6fc8af041503e24c141.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:16:42Z',
 'fuel_type': 'petrol',
 'id': '9c73803d-d5dc-5bdb-aadc-cbe2741945a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL93075',
 'listing': 'auction',
 'location': 'IT, Verona',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 211776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c73803d-d5dc-5bdb-aadc-cbe2741945a8/9c73803d-d5dc-5bdb-aadc-cbe2741945a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_d1efd91e92925e8e58d1f89fa5b523d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c73803d-d5dc-5bdb-aadc-cbe2741945a8/9c73803d-d5dc-5bdb-aadc-cbe2741945a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_9a1dfff1f58cf6fc8af041503e24c141.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c73803d-d5dc-5bdb-aadc-cbe2741945a8/9c73803d-d5dc-5bdb-aadc-cbe2741945a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_198af5b69f1360eea9561f1731985b2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c73803d-d5dc-5bdb-aadc-cbe2741945a8/9c73803d-d5dc-5bdb-aadc-cbe2741945a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_42b6abf176ab67ef8ca4c3b9042fc660.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c73803d-d5dc-5bdb-aadc-cbe2741945a8/9c73803d-d5dc-5bdb-aadc-cbe2741945a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/6d/db6d37b96c082f3b75e15ffd48e14339/pa/WL93075_bdd74369af11fd519e5b65849ba63b2d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-08-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2004}
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL93075%27 HTTP/1.1" 200 None
2026-03-30 09:00:51 [auto1.it] INFO: Saving data for WL93075: {'created_time': 1774861251.242375, 'last_price_update_time': 1774861251.242391, 'auction_closing_time': 1774970202.0}
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WL93075') HTTP/1.1" 204 0
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d1b5d0>
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_7a6304ffdce47e6fc6a183fb19d1f6b0.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_7a6304ffdce47e6fc6a183fb19d1f6b0.jpg saved to cache
2026-03-30 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6ccda8f-82b6-5052-b931-82cd4e0addec
2026-03-30 09:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_645674af1dda7543c96ecde4bf2c76bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_1ca761e0526465c1c920a9641db9a711.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_16b6538b775e12d4af7a43094d5460cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_aef67b7489f2f00bc4bd9791de38ebfd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_b8c585879eca0c221f50871f5aa16398.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_4a8c44d796302582790250726d36faf1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_c974747d12fb7b7d038b557c1ff48c1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_5d9eab947fb9c45dbbc8fdbaf8eeec1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ea1790>
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_645674af1dda7543c96ecde4bf2c76bc.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_645674af1dda7543c96ecde4bf2c76bc.jpg saved to cache
2026-03-30 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e683f7b-8d5a-5801-a492-40c117477db5
2026-03-30 09:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_99724f21893676bb3630781782e1b71d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_3be9b47e19bf6b80a87d09ffe0be11d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c37950>
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_1ca761e0526465c1c920a9641db9a711.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_1ca761e0526465c1c920a9641db9a711.jpg saved to cache
2026-03-30 09:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a042620-5b1b-5567-a541-4a05c052fbcf
2026-03-30 09:00:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c1f150>
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_16b6538b775e12d4af7a43094d5460cb.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_16b6538b775e12d4af7a43094d5460cb.jpg saved to cache
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f13a6768-d5ab-5299-b5b5-5f617cd1b501
2026-03-30 09:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e46810>
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_aef67b7489f2f00bc4bd9791de38ebfd.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_aef67b7489f2f00bc4bd9791de38ebfd.jpg saved to cache
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7
2026-03-30 09:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e4a850>
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F65%252F2d65299852468407fbdf3d2899c364c8%252Fpa%252FXY37684_b8c585879eca0c221f50871f5aa16398.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_b8c585879eca0c221f50871f5aa16398.jpg saved to cache
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e683f7b-8d5a-5801-a492-40c117477db5
2026-03-30 09:00:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e683f7b-8d5a-5801-a492-40c117477db5, skipping ID generation
2026-03-30 09:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e683f7b-8d5a-5801-a492-40c117477db5 with scrape type 1
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e683f7b-8d5a-5801-a492-40c117477db5 sending to next pipeline
2026-03-30 09:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e683f7b-8d5a-5801-a492-40c117477db5, identifier: XY37684
2026-03-30 09:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062bb3d0>
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F0c%252F290cb01380b036f978b0b5b09eaccf85%252Fpa%252FRX48220_4a8c44d796302582790250726d36faf1.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_4a8c44d796302582790250726d36faf1.jpg saved to cache
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a042620-5b1b-5567-a541-4a05c052fbcf
2026-03-30 09:00:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a042620-5b1b-5567-a541-4a05c052fbcf, skipping ID generation
2026-03-30 09:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a042620-5b1b-5567-a541-4a05c052fbcf with scrape type 1
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a042620-5b1b-5567-a541-4a05c052fbcf sending to next pipeline
2026-03-30 09:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8a042620-5b1b-5567-a541-4a05c052fbcf, identifier: RX48220
2026-03-30 09:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e4be10>
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_c974747d12fb7b7d038b557c1ff48c1a.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_c974747d12fb7b7d038b557c1ff48c1a.jpg saved to cache
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7
2026-03-30 09:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dc3a50>
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_5d9eab947fb9c45dbbc8fdbaf8eeec1f.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_5d9eab947fb9c45dbbc8fdbaf8eeec1f.jpg saved to cache
2026-03-30 09:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f13a6768-d5ab-5299-b5b5-5f617cd1b501
2026-03-30 09:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e683f7b-8d5a-5801-a492-40c117477db5 with identifier: XY37684
2026-03-30 09:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e683f7b-8d5a-5801-a492-40c117477db5 with identifier: XY37684
2026-03-30 09:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6e683f7b-8d5a-5801-a492-40c117477db5 with identifier: XY37684 to the API
2026-03-30 09:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_b8c585879eca0c221f50871f5aa16398.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:28:54Z',
 'fuel_type': 'diesel',
 'id': '6e683f7b-8d5a-5801-a492-40c117477db5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY37684',
 'listing': 'auction',
 'location': 'IT, Massa',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 161294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2425858,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_b8c585879eca0c221f50871f5aa16398.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2351409,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_645674af1dda7543c96ecde4bf2c76bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2236651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_74ebe4ab70ab1629f0613a775bf5da74.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1868881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_70815f2e33e261de546187a3757dd9da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2223359,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_8a792d12f5571a80749dc5fb97d99bd4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2194021,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_f0e6b697dbdf3198bfc476e6f7e6af5f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1926371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_323fa0c91ca75213675339b4a7e43422.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2341886,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_70ba10036aca184112c283815f7013c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380536,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_522d9fa79ce8fd6fc5cdf8baa51f752f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e683f7b-8d5a-5801-a492-40c117477db5/6e683f7b-8d5a-5801-a492-40c117477db5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2059606,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/65/2d65299852468407fbdf3d2899c364c8/pa/XY37684_a7d8c25492614c0e8271bc3617bb4352.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY37684%27 HTTP/1.1" 200 None
2026-03-30 09:00:53 [auto1.it] INFO: Saving data for XY37684: {'created_time': 1774861253.408201, 'last_price_update_time': 1774861253.408213, 'auction_closing_time': 1774970934.0}
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XY37684') HTTP/1.1" 204 0
2026-03-30 09:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8a042620-5b1b-5567-a541-4a05c052fbcf with identifier: RX48220
2026-03-30 09:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8a042620-5b1b-5567-a541-4a05c052fbcf with identifier: RX48220
2026-03-30 09:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8a042620-5b1b-5567-a541-4a05c052fbcf with identifier: RX48220 to the API
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_4a8c44d796302582790250726d36faf1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:04:08Z',
 'fuel_type': 'diesel',
 'id': '8a042620-5b1b-5567-a541-4a05c052fbcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX48220',
 'listing': 'auction',
 'location': 'IT, Alessandria',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 79828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2567223,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_4a8c44d796302582790250726d36faf1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2457684,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_1ca761e0526465c1c920a9641db9a711.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518562,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_eadd2198f644342ae86db578ebae427d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2195718,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_1c10f3915c322a8779e070c7c05baca1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2556979,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_9f2dd9af5fec890f2be39e8b3cda2d15.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2553738,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_845eeb8d458df6c34e8913ae81f6195f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2545747,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_628b0f68c0eb7aa050f5d8bca7eff382.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2698411,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_1217b5636ebf22d5cd595484741dad17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608328,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_d61f7ec7ef3a46c524b7f3209e547772.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a042620-5b1b-5567-a541-4a05c052fbcf/8a042620-5b1b-5567-a541-4a05c052fbcf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2451185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/0c/290cb01380b036f978b0b5b09eaccf85/pa/RX48220_81bcf3f58dfa648fe2d82c26198c0b58.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2013}
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX48220%27 HTTP/1.1" 200 None
2026-03-30 09:00:53 [auto1.it] INFO: Saving data for RX48220: {'created_time': 1774861253.893271, 'last_price_update_time': 1774861253.893282, 'auction_closing_time': 1774969448.0}
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX48220') HTTP/1.1" 204 0
2026-03-30 09:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA12696/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL65861/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c87210>
2026-03-30 09:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_99724f21893676bb3630781782e1b71d.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_99724f21893676bb3630781782e1b71d.jpg saved to cache
2026-03-30 09:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6ccda8f-82b6-5052-b931-82cd4e0addec
2026-03-30 09:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062b3690>
2026-03-30 09:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_3be9b47e19bf6b80a87d09ffe0be11d6.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_3be9b47e19bf6b80a87d09ffe0be11d6.jpg saved to cache
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6ccda8f-82b6-5052-b931-82cd4e0addec
2026-03-30 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_2f263146e6f6af1397c4475cf0fff4ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_348664629d15d6203741e5dae8242c9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_67f1ccdd73b3aa494424cba1be271154.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_8015e834436fa2a05d15284f447338bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_13025e12ae1a93f1a66b82b73e337dc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_00c4a6f7e617bcbcc81edeeba87efc0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06df1150>
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_2f263146e6f6af1397c4475cf0fff4ab.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_2f263146e6f6af1397c4475cf0fff4ab.jpg saved to cache
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f13a6768-d5ab-5299-b5b5-5f617cd1b501
2026-03-30 09:00:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06296290>
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_348664629d15d6203741e5dae8242c9e.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_348664629d15d6203741e5dae8242c9e.jpg saved to cache
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f13a6768-d5ab-5299-b5b5-5f617cd1b501
2026-03-30 09:00:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0624a310>
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_67f1ccdd73b3aa494424cba1be271154.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_67f1ccdd73b3aa494424cba1be271154.jpg saved to cache
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7
2026-03-30 09:00:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06239610>
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_8015e834436fa2a05d15284f447338bc.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_8015e834436fa2a05d15284f447338bc.jpg saved to cache
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7
2026-03-30 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_5296314e0e17065a5d193ce8f1daf6f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_acd2c5fb23b76298bc1e4c4a1deef161.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB20561> (referer: https://www.auto1.com/v1/car-details-view/TB20561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP93203/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX80167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY72702/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d03050>
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_13025e12ae1a93f1a66b82b73e337dc9.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_13025e12ae1a93f1a66b82b73e337dc9.jpg saved to cache
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6ccda8f-82b6-5052-b931-82cd4e0addec
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e7a8d0>
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_00c4a6f7e617bcbcc81edeeba87efc0b.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_00c4a6f7e617bcbcc81edeeba87efc0b.jpg saved to cache
2026-03-30 09:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6ccda8f-82b6-5052-b931-82cd4e0addec
2026-03-30 09:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd8dd0>
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fb3%252F65b381d85cfa220196a70495f18dd3a4%252Fpa%252FKS72345_5296314e0e17065a5d193ce8f1daf6f0.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_5296314e0e17065a5d193ce8f1daf6f0.jpg saved to cache
2026-03-30 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6ccda8f-82b6-5052-b931-82cd4e0addec
2026-03-30 09:00:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6ccda8f-82b6-5052-b931-82cd4e0addec, skipping ID generation
2026-03-30 09:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6ccda8f-82b6-5052-b931-82cd4e0addec with scrape type 1
2026-03-30 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6ccda8f-82b6-5052-b931-82cd4e0addec sending to next pipeline
2026-03-30 09:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d6ccda8f-82b6-5052-b931-82cd4e0addec, identifier: KS72345
2026-03-30 09:00:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06296e50>
2026-03-30 09:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_acd2c5fb23b76298bc1e4c4a1deef161.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_acd2c5fb23b76298bc1e4c4a1deef161.jpg saved to cache
2026-03-30 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f13a6768-d5ab-5299-b5b5-5f617cd1b501
2026-03-30 09:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f95fd11-b5d5-50e6-9354-06441d0fc782 with identifier: TB20561
2026-03-30 09:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f95fd11-b5d5-50e6-9354-06441d0fc782 with scrape type 1
2026-03-30 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f95fd11-b5d5-50e6-9354-06441d0fc782
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_3c00e8b919607934539199683d1f6aff.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_3c00e8b919607934539199683d1f6aff.jpg not downloaded yet
2026-03-30 09:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d6ccda8f-82b6-5052-b931-82cd4e0addec with identifier: KS72345
2026-03-30 09:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d6ccda8f-82b6-5052-b931-82cd4e0addec with identifier: KS72345
2026-03-30 09:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d6ccda8f-82b6-5052-b931-82cd4e0addec with identifier: KS72345 to the API
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_5296314e0e17065a5d193ce8f1daf6f0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:30:21Z',
 'fuel_type': 'diesel',
 'id': 'd6ccda8f-82b6-5052-b931-82cd4e0addec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS72345',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 41889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_00c4a6f7e617bcbcc81edeeba87efc0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_5296314e0e17065a5d193ce8f1daf6f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_13025e12ae1a93f1a66b82b73e337dc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_99724f21893676bb3630781782e1b71d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_3be9b47e19bf6b80a87d09ffe0be11d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_7a6304ffdce47e6fc6a183fb19d1f6b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_4230567c922b0c1b255b2480a2ce224f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_96eee7bb59cbf60ce2e55a6fa719ae31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_fec174bc28be6dc5fba974bb6a880542.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6ccda8f-82b6-5052-b931-82cd4e0addec/d6ccda8f-82b6-5052-b931-82cd4e0addec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/b3/65b381d85cfa220196a70495f18dd3a4/pa/KS72345_58f8127bcb7c07695ade871aa16a83fe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2019}
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS72345%27 HTTP/1.1" 200 None
2026-03-30 09:00:55 [auto1.it] INFO: Saving data for KS72345: {'created_time': 1774861255.761786, 'last_price_update_time': 1774861255.761801, 'auction_closing_time': 1774971021.0}
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KS72345') HTTP/1.1" 204 0
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_c17c7920a626bc73e5db0b6da4eb91d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_c17c7920a626bc73e5db0b6da4eb91d2.jpg not downloaded yet
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_a5f073e3bfa8b07922ba4ae0191bc163.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_a5f073e3bfa8b07922ba4ae0191bc163.jpg not downloaded yet
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_5990b4b91f4ccce5fb14b8fee338f690.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_5990b4b91f4ccce5fb14b8fee338f690.jpg not downloaded yet
2026-03-30 09:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_bae2f8a68e6223bedd80d1caf791fdb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_e6dfec3b3d7a74a1a2d482702f19bd2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_e6dfec3b3d7a74a1a2d482702f19bd2f.jpg not downloaded yet
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_186d9096d1cd91c9b519610636f057d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_186d9096d1cd91c9b519610636f057d8.jpg not downloaded yet
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_9170b432fb66167540e868f12669f24f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_9170b432fb66167540e868f12669f24f.jpg not downloaded yet
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_1e4c246328dcdebe0b0f1af5bf7c718b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_1e4c246328dcdebe0b0f1af5bf7c718b.jpg not downloaded yet
2026-03-30 09:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062c7f50>
2026-03-30 09:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_bae2f8a68e6223bedd80d1caf791fdb7.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_bae2f8a68e6223bedd80d1caf791fdb7.jpg saved to cache
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_0b0c921991ccdabfb137dba0c14485c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_0b0c921991ccdabfb137dba0c14485c5.jpg not downloaded yet
2026-03-30 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA12696> (referer: https://www.auto1.com/v1/car-details-view/XA12696/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_9b68ac230a8957a14a8e1a85701e1e14.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_9b68ac230a8957a14a8e1a85701e1e14.jpg not downloaded yet
2026-03-30 09:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_0c0d5a4c51472c5af041cc454f47a044.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_5990b4b91f4ccce5fb14b8fee338f690.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_a25a6b5ecdcf920bcadd37ded0ed15cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL65861> (referer: https://www.auto1.com/v1/car-details-view/FL65861/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_a5daf44f2e8812acf4c16267a8de6a18.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_8af7556d1a63e165f11d4bed743f6188.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_041b66d55e4b4fd16cf5f848c4c5b1be.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae986554-b72d-5eed-ba3b-79a480fc0029 with identifier: XA12696
2026-03-30 09:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae986554-b72d-5eed-ba3b-79a480fc0029 with scrape type 1
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae986554-b72d-5eed-ba3b-79a480fc0029
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F8c%252F828c01f15df772c9d33eac4d979c5555%252Fpa%252FXA12696_324024bf6eb322637511555cbaf510d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_324024bf6eb322637511555cbaf510d9.jpg already downloaded
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F8c%252F828c01f15df772c9d33eac4d979c5555%252Fpa%252FXA12696_cf49110200c7315cbc2f33637313b4f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_cf49110200c7315cbc2f33637313b4f1.jpg already downloaded
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F8c%252F828c01f15df772c9d33eac4d979c5555%252Fpa%252FXA12696_1bf3ffa6234e4439bc9fe64bdc6da395.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1bf3ffa6234e4439bc9fe64bdc6da395.jpg already downloaded
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F8c%252F828c01f15df772c9d33eac4d979c5555%252Fpa%252FXA12696_82f2147f8284b591c0ddd8d2206ec9a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_82f2147f8284b591c0ddd8d2206ec9a9.jpg already downloaded
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F8c%252F828c01f15df772c9d33eac4d979c5555%252Fpa%252FXA12696_4759e3b2e79e65056dedf745000c4158.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4759e3b2e79e65056dedf745000c4158.jpg already downloaded
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F8c%252F828c01f15df772c9d33eac4d979c5555%252Fpa%252FXA12696_163c3bf6a6534b00541c8953d5e48cc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_163c3bf6a6534b00541c8953d5e48cc9.jpg already downloaded
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F8c%252F828c01f15df772c9d33eac4d979c5555%252Fpa%252FXA12696_4b4560a9a054e0c036a19f201eb29858.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4b4560a9a054e0c036a19f201eb29858.jpg already downloaded
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F8c%252F828c01f15df772c9d33eac4d979c5555%252Fpa%252FXA12696_6bfb6b3770b2dc99372d0ec907626ac9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_6bfb6b3770b2dc99372d0ec907626ac9.jpg already downloaded
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F8c%252F828c01f15df772c9d33eac4d979c5555%252Fpa%252FXA12696_ab9a3d05f263fe97b27a8316658d1495.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_ab9a3d05f263fe97b27a8316658d1495.jpg already downloaded
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F8c%252F828c01f15df772c9d33eac4d979c5555%252Fpa%252FXA12696_1951c6f63a66d9b8a2439d6547e57bbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1951c6f63a66d9b8a2439d6547e57bbd.jpg already downloaded
2026-03-30 09:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ae986554-b72d-5eed-ba3b-79a480fc0029, identifier: XA12696
2026-03-30 09:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ae986554-b72d-5eed-ba3b-79a480fc0029 with identifier: XA12696
2026-03-30 09:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ae986554-b72d-5eed-ba3b-79a480fc0029 with identifier: XA12696
2026-03-30 09:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ae986554-b72d-5eed-ba3b-79a480fc0029 with identifier: XA12696 to the API
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XA12696>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:32:22Z',
 'fuel_type': 'diesel',
 'id': 'ae986554-b72d-5eed-ba3b-79a480fc0029',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA12696',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 201013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_324024bf6eb322637511555cbaf510d9.jpg',
                'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_cf49110200c7315cbc2f33637313b4f1.jpg',
                'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1bf3ffa6234e4439bc9fe64bdc6da395.jpg',
                'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_82f2147f8284b591c0ddd8d2206ec9a9.jpg',
                'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4759e3b2e79e65056dedf745000c4158.jpg',
                'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_163c3bf6a6534b00541c8953d5e48cc9.jpg',
                'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4b4560a9a054e0c036a19f201eb29858.jpg',
                'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_6bfb6b3770b2dc99372d0ec907626ac9.jpg',
                'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_ab9a3d05f263fe97b27a8316658d1495.jpg',
                'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1951c6f63a66d9b8a2439d6547e57bbd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2418909,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_324024bf6eb322637511555cbaf510d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2455853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_cf49110200c7315cbc2f33637313b4f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2427984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1bf3ffa6234e4439bc9fe64bdc6da395.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_82f2147f8284b591c0ddd8d2206ec9a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2334076,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4759e3b2e79e65056dedf745000c4158.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2323580,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_163c3bf6a6534b00541c8953d5e48cc9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2161817,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4b4560a9a054e0c036a19f201eb29858.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2285426,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_6bfb6b3770b2dc99372d0ec907626ac9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2379891,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_ab9a3d05f263fe97b27a8316658d1495.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1951c6f63a66d9b8a2439d6547e57bbd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2014}
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XA12696%27 HTTP/1.1" 200 None
2026-03-30 09:00:57 [auto1.it] INFO: Saving data for XA12696: {'created_time': 1774861257.056897, 'last_price_update_time': 1774861257.05691, 'auction_closing_time': 1774971142.0}
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XA12696') HTTP/1.1" 204 0
2026-03-30 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_9170b432fb66167540e868f12669f24f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_0b0c921991ccdabfb137dba0c14485c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_9b68ac230a8957a14a8e1a85701e1e14.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_186d9096d1cd91c9b519610636f057d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_1e4c246328dcdebe0b0f1af5bf7c718b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV33372/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ43487/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE54405/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD15885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e16b6e790>
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_0c0d5a4c51472c5af041cc454f47a044.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_0c0d5a4c51472c5af041cc454f47a044.jpg saved to cache
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f13a6768-d5ab-5299-b5b5-5f617cd1b501
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd58d0>
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_5990b4b91f4ccce5fb14b8fee338f690.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_5990b4b91f4ccce5fb14b8fee338f690.jpg saved to cache
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f95fd11-b5d5-50e6-9354-06441d0fc782
2026-03-30 09:00:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e43850>
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_a25a6b5ecdcf920bcadd37ded0ed15cd.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_a25a6b5ecdcf920bcadd37ded0ed15cd.jpg saved to cache
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7
2026-03-30 09:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bda64310-b51c-5ef9-bd65-d913f17b8952 with identifier: FL65861
2026-03-30 09:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bda64310-b51c-5ef9-bd65-d913f17b8952 with scrape type 1
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bda64310-b51c-5ef9-bd65-d913f17b8952
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_6336328e080172ce459959018b5e194b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_6336328e080172ce459959018b5e194b.jpg not downloaded yet
2026-03-30 09:00:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd79d0>
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbf%252F5fbf2572e2d8269d901ff1663157fb81%252Fpa%252FXN71458_a5daf44f2e8812acf4c16267a8de6a18.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_a5daf44f2e8812acf4c16267a8de6a18.jpg saved to cache
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7
2026-03-30 09:00:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5b0f44d-37f3-5ccf-8278-f60cac50edd7, skipping ID generation
2026-03-30 09:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7 with scrape type 1
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5b0f44d-37f3-5ccf-8278-f60cac50edd7 sending to next pipeline
2026-03-30 09:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f5b0f44d-37f3-5ccf-8278-f60cac50edd7, identifier: XN71458
2026-03-30 09:00:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06388d50>
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6d%252Fc66d5fdbf9c48937ec151e4f035075e1%252Fpa%252FPE32711_8af7556d1a63e165f11d4bed743f6188.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_8af7556d1a63e165f11d4bed743f6188.jpg saved to cache
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f13a6768-d5ab-5299-b5b5-5f617cd1b501
2026-03-30 09:00:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f13a6768-d5ab-5299-b5b5-5f617cd1b501, skipping ID generation
2026-03-30 09:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f13a6768-d5ab-5299-b5b5-5f617cd1b501 with scrape type 1
2026-03-30 09:00:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f13a6768-d5ab-5299-b5b5-5f617cd1b501 sending to next pipeline
2026-03-30 09:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f13a6768-d5ab-5299-b5b5-5f617cd1b501, identifier: PE32711
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d9d050>
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_041b66d55e4b4fd16cf5f848c4c5b1be.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_041b66d55e4b4fd16cf5f848c4c5b1be.jpg saved to cache
2026-03-30 09:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb2ef62d-81fd-55da-a334-042e161f797a
2026-03-30 09:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f5b0f44d-37f3-5ccf-8278-f60cac50edd7 with identifier: XN71458
2026-03-30 09:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f5b0f44d-37f3-5ccf-8278-f60cac50edd7 with identifier: XN71458
2026-03-30 09:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f5b0f44d-37f3-5ccf-8278-f60cac50edd7 with identifier: XN71458 to the API
2026-03-30 09:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_a5daf44f2e8812acf4c16267a8de6a18.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:28:35Z',
 'fuel_type': 'petrol',
 'id': 'f5b0f44d-37f3-5ccf-8278-f60cac50edd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN71458',
 'listing': 'auction',
 'location': 'IT, Garbagnate Milanese',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 45039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2465923,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_a5daf44f2e8812acf4c16267a8de6a18.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2423288,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_a25a6b5ecdcf920bcadd37ded0ed15cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2426524,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_bae2f8a68e6223bedd80d1caf791fdb7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2395409,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_67f1ccdd73b3aa494424cba1be271154.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2448205,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_8015e834436fa2a05d15284f447338bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2376891,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_c974747d12fb7b7d038b557c1ff48c1a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2387246,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_97a9bac5fa8975376fa1147f3acb4310.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2475157,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_3276e71a1ee006a0e893a15c89a9e74e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2332636,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_3e7721bcb541a5b7bfe7ad05af8d3f64.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5b0f44d-37f3-5ccf-8278-f60cac50edd7/f5b0f44d-37f3-5ccf-8278-f60cac50edd7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2375767,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/bf/5fbf2572e2d8269d901ff1663157fb81/pa/XN71458_aef67b7489f2f00bc4bd9791de38ebfd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN71458%27 HTTP/1.1" 200 None
2026-03-30 09:00:58 [auto1.it] INFO: Saving data for XN71458: {'created_time': 1774861258.525803, 'last_price_update_time': 1774861258.525817, 'auction_closing_time': 1774970915.0}
2026-03-30 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XN71458') HTTP/1.1" 204 0
2026-03-30 09:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f13a6768-d5ab-5299-b5b5-5f617cd1b501 with identifier: PE32711
2026-03-30 09:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f13a6768-d5ab-5299-b5b5-5f617cd1b501 with identifier: PE32711
2026-03-30 09:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f13a6768-d5ab-5299-b5b5-5f617cd1b501 with identifier: PE32711 to the API
2026-03-30 09:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_8af7556d1a63e165f11d4bed743f6188.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:24:46Z',
 'fuel_type': 'diesel',
 'id': 'f13a6768-d5ab-5299-b5b5-5f617cd1b501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE32711',
 'listing': 'auction',
 'location': 'IT, Salerno',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 56499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2171695,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_8af7556d1a63e165f11d4bed743f6188.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1986084,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_0c0d5a4c51472c5af041cc454f47a044.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1973490,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_acd2c5fb23b76298bc1e4c4a1deef161.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1981958,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_2f263146e6f6af1397c4475cf0fff4ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2032511,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_348664629d15d6203741e5dae8242c9e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1973903,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_5d9eab947fb9c45dbbc8fdbaf8eeec1f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1793225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_7ae4752240f5b2abcafcc4d00dcbcb62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1975808,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_36084b29fafad5982995dc96d0fea579.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2053090,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_f0ae856b0e0ea4244c0283086e909468.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13a6768-d5ab-5299-b5b5-5f617cd1b501/f13a6768-d5ab-5299-b5b5-5f617cd1b501_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2137280,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6d/c66d5fdbf9c48937ec151e4f035075e1/pa/PE32711_16b6538b775e12d4af7a43094d5460cb.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.5 Blue-HDi Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2022}
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE32711%27 HTTP/1.1" 200 None
2026-03-30 09:00:59 [auto1.it] INFO: Saving data for PE32711: {'created_time': 1774861259.065074, 'last_price_update_time': 1774861259.065086, 'auction_closing_time': 1774970686.0}
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PE32711') HTTP/1.1" 204 0
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_84b523a1e9b0661cb941c9aedb126495.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_84b523a1e9b0661cb941c9aedb126495.jpg not downloaded yet
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ea2210>
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_9170b432fb66167540e868f12669f24f.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_9170b432fb66167540e868f12669f24f.jpg saved to cache
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f95fd11-b5d5-50e6-9354-06441d0fc782
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e172d0>
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_0b0c921991ccdabfb137dba0c14485c5.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_0b0c921991ccdabfb137dba0c14485c5.jpg saved to cache
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f95fd11-b5d5-50e6-9354-06441d0fc782
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063d93d0>
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_9b68ac230a8957a14a8e1a85701e1e14.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_9b68ac230a8957a14a8e1a85701e1e14.jpg saved to cache
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f95fd11-b5d5-50e6-9354-06441d0fc782
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e14310>
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_186d9096d1cd91c9b519610636f057d8.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_186d9096d1cd91c9b519610636f057d8.jpg saved to cache
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f95fd11-b5d5-50e6-9354-06441d0fc782
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dcc550>
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_1e4c246328dcdebe0b0f1af5bf7c718b.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_1e4c246328dcdebe0b0f1af5bf7c718b.jpg saved to cache
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f95fd11-b5d5-50e6-9354-06441d0fc782
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_97596f66368303f73aefd14f150e9d35.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_97596f66368303f73aefd14f150e9d35.jpg not downloaded yet
2026-03-30 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD37859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_caec39cd9164e5dea46781b8213c00c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_caec39cd9164e5dea46781b8213c00c4.jpg not downloaded yet
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_1ff8e26bc40070d022d21e16d47ffd7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_1ff8e26bc40070d022d21e16d47ffd7b.jpg not downloaded yet
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_0d6fa878a34b308303f2f4c91d929bdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_0d6fa878a34b308303f2f4c91d929bdc.jpg not downloaded yet
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_7c5f38a2833523dca68991f7b7dcf9c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_7c5f38a2833523dca68991f7b7dcf9c8.jpg not downloaded yet
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_7aa626cab3bc5ad1ecd83b877e986523.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_7aa626cab3bc5ad1ecd83b877e986523.jpg not downloaded yet
2026-03-30 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_3c00e8b919607934539199683d1f6aff.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_a5f073e3bfa8b07922ba4ae0191bc163.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_d4a75c3f117fbed12a48ff101a380b12.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_d4a75c3f117fbed12a48ff101a380b12.jpg not downloaded yet
2026-03-30 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_84b523a1e9b0661cb941c9aedb126495.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_6336328e080172ce459959018b5e194b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_6db2f5667d0624dcfd926c48febe1281.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_6db2f5667d0624dcfd926c48febe1281.jpg not downloaded yet
2026-03-30 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_e6dfec3b3d7a74a1a2d482702f19bd2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063f9ad0>
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_3c00e8b919607934539199683d1f6aff.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_3c00e8b919607934539199683d1f6aff.jpg saved to cache
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f95fd11-b5d5-50e6-9354-06441d0fc782
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0cd57c50>
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_a5f073e3bfa8b07922ba4ae0191bc163.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_a5f073e3bfa8b07922ba4ae0191bc163.jpg saved to cache
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f95fd11-b5d5-50e6-9354-06441d0fc782
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063c5110>
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_84b523a1e9b0661cb941c9aedb126495.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_84b523a1e9b0661cb941c9aedb126495.jpg saved to cache
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bda64310-b51c-5ef9-bd65-d913f17b8952
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c75290>
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_6336328e080172ce459959018b5e194b.jpg') HTTP/1.1" 204 0
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_6336328e080172ce459959018b5e194b.jpg saved to cache
2026-03-30 09:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bda64310-b51c-5ef9-bd65-d913f17b8952
2026-03-30 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_c17c7920a626bc73e5db0b6da4eb91d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_7aa626cab3bc5ad1ecd83b877e986523.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_d4a75c3f117fbed12a48ff101a380b12.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_7c5f38a2833523dca68991f7b7dcf9c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_6db2f5667d0624dcfd926c48febe1281.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f48f50>
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_e6dfec3b3d7a74a1a2d482702f19bd2f.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_e6dfec3b3d7a74a1a2d482702f19bd2f.jpg saved to cache
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f95fd11-b5d5-50e6-9354-06441d0fc782
2026-03-30 09:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_caec39cd9164e5dea46781b8213c00c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d0692d0>
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fb6%252F6fb68905593c2f7aa751e2fd9a6f6efd%252Fpa%252FTB20561_c17c7920a626bc73e5db0b6da4eb91d2.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_c17c7920a626bc73e5db0b6da4eb91d2.jpg saved to cache
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f95fd11-b5d5-50e6-9354-06441d0fc782
2026-03-30 09:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f95fd11-b5d5-50e6-9354-06441d0fc782, skipping ID generation
2026-03-30 09:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f95fd11-b5d5-50e6-9354-06441d0fc782 with scrape type 1
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f95fd11-b5d5-50e6-9354-06441d0fc782 sending to next pipeline
2026-03-30 09:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1f95fd11-b5d5-50e6-9354-06441d0fc782, identifier: TB20561
2026-03-30 09:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1f95fd11-b5d5-50e6-9354-06441d0fc782 with identifier: TB20561
2026-03-30 09:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1f95fd11-b5d5-50e6-9354-06441d0fc782 with identifier: TB20561
2026-03-30 09:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1f95fd11-b5d5-50e6-9354-06441d0fc782 with identifier: TB20561 to the API
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_c17c7920a626bc73e5db0b6da4eb91d2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:05:39Z',
 'fuel_type': 'petrol',
 'id': '1f95fd11-b5d5-50e6-9354-06441d0fc782',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB20561',
 'listing': 'auction',
 'location': 'IT, Como',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 82041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_3c00e8b919607934539199683d1f6aff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_c17c7920a626bc73e5db0b6da4eb91d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_a5f073e3bfa8b07922ba4ae0191bc163.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_5990b4b91f4ccce5fb14b8fee338f690.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_e6dfec3b3d7a74a1a2d482702f19bd2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_186d9096d1cd91c9b519610636f057d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_9170b432fb66167540e868f12669f24f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_1e4c246328dcdebe0b0f1af5bf7c718b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_0b0c921991ccdabfb137dba0c14485c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95fd11-b5d5-50e6-9354-06441d0fc782/1f95fd11-b5d5-50e6-9354-06441d0fc782_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/b6/6fb68905593c2f7aa751e2fd9a6f6efd/pa/TB20561_9b68ac230a8957a14a8e1a85701e1e14.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB20561%27 HTTP/1.1" 200 None
2026-03-30 09:01:00 [auto1.it] INFO: Saving data for TB20561: {'created_time': 1774861260.64545, 'last_price_update_time': 1774861260.645461, 'auction_closing_time': 1774969539.0}
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TB20561') HTTP/1.1" 204 0
2026-03-30 09:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_97596f66368303f73aefd14f150e9d35.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_1ff8e26bc40070d022d21e16d47ffd7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_0d6fa878a34b308303f2f4c91d929bdc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV33372> (referer: https://www.auto1.com/v1/car-details-view/JV33372/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT13926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062cbf50>
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_7aa626cab3bc5ad1ecd83b877e986523.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_7aa626cab3bc5ad1ecd83b877e986523.jpg saved to cache
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bda64310-b51c-5ef9-bd65-d913f17b8952
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062bf250>
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_d4a75c3f117fbed12a48ff101a380b12.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_d4a75c3f117fbed12a48ff101a380b12.jpg saved to cache
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bda64310-b51c-5ef9-bd65-d913f17b8952
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c4d310>
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_7c5f38a2833523dca68991f7b7dcf9c8.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_7c5f38a2833523dca68991f7b7dcf9c8.jpg saved to cache
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bda64310-b51c-5ef9-bd65-d913f17b8952
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062bfe90>
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_6db2f5667d0624dcfd926c48febe1281.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_6db2f5667d0624dcfd926c48febe1281.jpg saved to cache
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bda64310-b51c-5ef9-bd65-d913f17b8952
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062be550>
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_caec39cd9164e5dea46781b8213c00c4.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_caec39cd9164e5dea46781b8213c00c4.jpg saved to cache
2026-03-30 09:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bda64310-b51c-5ef9-bd65-d913f17b8952
2026-03-30 09:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE54405> (referer: https://www.auto1.com/v1/car-details-view/BE54405/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c4f950>
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_97596f66368303f73aefd14f150e9d35.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_97596f66368303f73aefd14f150e9d35.jpg saved to cache
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bda64310-b51c-5ef9-bd65-d913f17b8952
2026-03-30 09:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0624a4d0>
2026-03-30 09:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_1ff8e26bc40070d022d21e16d47ffd7b.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_1ff8e26bc40070d022d21e16d47ffd7b.jpg saved to cache
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bda64310-b51c-5ef9-bd65-d913f17b8952
2026-03-30 09:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d4f290>
2026-03-30 09:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F40%252F2340af8a75ff48dfa8ec2f885f5465df%252Fpa%252FFL65861_0d6fa878a34b308303f2f4c91d929bdc.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_0d6fa878a34b308303f2f4c91d929bdc.jpg saved to cache
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bda64310-b51c-5ef9-bd65-d913f17b8952
2026-03-30 09:01:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bda64310-b51c-5ef9-bd65-d913f17b8952, skipping ID generation
2026-03-30 09:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bda64310-b51c-5ef9-bd65-d913f17b8952 with scrape type 1
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bda64310-b51c-5ef9-bd65-d913f17b8952 sending to next pipeline
2026-03-30 09:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bda64310-b51c-5ef9-bd65-d913f17b8952, identifier: FL65861
2026-03-30 09:01:01 [auto1.it] INFO: Channel: 24h | Page: 3 | totalHits: 3284 | hits on page: 40
2026-03-30 09:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e14e728-5fea-588b-b8a7-5cc4900324e0 with identifier: JV33372
2026-03-30 09:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e14e728-5fea-588b-b8a7-5cc4900324e0 with scrape type 1
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e14e728-5fea-588b-b8a7-5cc4900324e0
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F75%252Fd9757709bf7a231ebc8d301fa2ba2898%252Fpa%252FJV33372_5b5cd335b8eedc2711d587ccd449e98a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_5b5cd335b8eedc2711d587ccd449e98a.jpg already downloaded
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F75%252Fd9757709bf7a231ebc8d301fa2ba2898%252Fpa%252FJV33372_bc4ed68597f4bb8a9bd7936cc626945a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_bc4ed68597f4bb8a9bd7936cc626945a.jpg already downloaded
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F75%252Fd9757709bf7a231ebc8d301fa2ba2898%252Fpa%252FJV33372_b51fccec5236240bd870d4819d583796.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_b51fccec5236240bd870d4819d583796.jpg already downloaded
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F75%252Fd9757709bf7a231ebc8d301fa2ba2898%252Fpa%252FJV33372_a21e403a87fd23f419a4c86f313f2266.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_a21e403a87fd23f419a4c86f313f2266.jpg already downloaded
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F75%252Fd9757709bf7a231ebc8d301fa2ba2898%252Fpa%252FJV33372_2d1356791d7f0689cc68af3dbffcde03.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_2d1356791d7f0689cc68af3dbffcde03.jpg already downloaded
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F75%252Fd9757709bf7a231ebc8d301fa2ba2898%252Fpa%252FJV33372_3ede407a60e767b8f9a1d35648c5d882.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_3ede407a60e767b8f9a1d35648c5d882.jpg already downloaded
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F75%252Fd9757709bf7a231ebc8d301fa2ba2898%252Fpa%252FJV33372_de670633fbe6b17eef19d70054b36a2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_de670633fbe6b17eef19d70054b36a2f.jpg already downloaded
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F75%252Fd9757709bf7a231ebc8d301fa2ba2898%252Fpa%252FJV33372_23e2a5be2fa6db57bd7bbd7a5b58d573.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_23e2a5be2fa6db57bd7bbd7a5b58d573.jpg already downloaded
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F75%252Fd9757709bf7a231ebc8d301fa2ba2898%252Fpa%252FJV33372_27bfac18e3534725eea33772c1817541.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_27bfac18e3534725eea33772c1817541.jpg already downloaded
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F75%252Fd9757709bf7a231ebc8d301fa2ba2898%252Fpa%252FJV33372_1b7762ae2022c5d931820d96e7203d6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_1b7762ae2022c5d931820d96e7203d6c.jpg already downloaded
2026-03-30 09:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1e14e728-5fea-588b-b8a7-5cc4900324e0, identifier: JV33372
2026-03-30 09:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bda64310-b51c-5ef9-bd65-d913f17b8952 with identifier: FL65861
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 09:01:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bda64310-b51c-5ef9-bd65-d913f17b8952 with identifier: FL65861
2026-03-30 09:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bda64310-b51c-5ef9-bd65-d913f17b8952 with identifier: FL65861 to the API
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_0d6fa878a34b308303f2f4c91d929bdc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:46:58Z',
 'fuel_type': 'petrol',
 'id': 'bda64310-b51c-5ef9-bd65-d913f17b8952',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL65861',
 'listing': 'auction',
 'location': 'IT, Ravenna',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 130192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_6336328e080172ce459959018b5e194b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_84b523a1e9b0661cb941c9aedb126495.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_97596f66368303f73aefd14f150e9d35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_caec39cd9164e5dea46781b8213c00c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_1ff8e26bc40070d022d21e16d47ffd7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_0d6fa878a34b308303f2f4c91d929bdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_7c5f38a2833523dca68991f7b7dcf9c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_7aa626cab3bc5ad1ecd83b877e986523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_d4a75c3f117fbed12a48ff101a380b12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda64310-b51c-5ef9-bd65-d913f17b8952/bda64310-b51c-5ef9-bd65-d913f17b8952_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/40/2340af8a75ff48dfa8ec2f885f5465df/pa/FL65861_6db2f5667d0624dcfd926c48febe1281.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo Pop Star',
 'transmission': 'automatic',
 'trim': 'Pop Star',
 'year': 2015}
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL65861%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [auto1.it] INFO: Saving data for FL65861: {'created_time': 1774861262.10524, 'last_price_update_time': 1774861262.105251, 'auction_closing_time': 1774972018.0}
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FL65861') HTTP/1.1" 204 0
2026-03-30 09:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1e14e728-5fea-588b-b8a7-5cc4900324e0 with identifier: JV33372
2026-03-30 09:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1e14e728-5fea-588b-b8a7-5cc4900324e0 with identifier: JV33372
2026-03-30 09:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1e14e728-5fea-588b-b8a7-5cc4900324e0 with identifier: JV33372 to the API
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JV33372>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:15:37Z',
 'fuel_type': 'petrol',
 'id': '1e14e728-5fea-588b-b8a7-5cc4900324e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV33372',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 78142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_5b5cd335b8eedc2711d587ccd449e98a.jpg',
                'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_bc4ed68597f4bb8a9bd7936cc626945a.jpg',
                'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_b51fccec5236240bd870d4819d583796.jpg',
                'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_a21e403a87fd23f419a4c86f313f2266.jpg',
                'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_2d1356791d7f0689cc68af3dbffcde03.jpg',
                'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_3ede407a60e767b8f9a1d35648c5d882.jpg',
                'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_de670633fbe6b17eef19d70054b36a2f.jpg',
                'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_23e2a5be2fa6db57bd7bbd7a5b58d573.jpg',
                'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_27bfac18e3534725eea33772c1817541.jpg',
                'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_1b7762ae2022c5d931820d96e7203d6c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e14e728-5fea-588b-b8a7-5cc4900324e0/1e14e728-5fea-588b-b8a7-5cc4900324e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2777143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_5b5cd335b8eedc2711d587ccd449e98a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e14e728-5fea-588b-b8a7-5cc4900324e0/1e14e728-5fea-588b-b8a7-5cc4900324e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2699627,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_bc4ed68597f4bb8a9bd7936cc626945a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e14e728-5fea-588b-b8a7-5cc4900324e0/1e14e728-5fea-588b-b8a7-5cc4900324e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_b51fccec5236240bd870d4819d583796.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e14e728-5fea-588b-b8a7-5cc4900324e0/1e14e728-5fea-588b-b8a7-5cc4900324e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_a21e403a87fd23f419a4c86f313f2266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e14e728-5fea-588b-b8a7-5cc4900324e0/1e14e728-5fea-588b-b8a7-5cc4900324e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_2d1356791d7f0689cc68af3dbffcde03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e14e728-5fea-588b-b8a7-5cc4900324e0/1e14e728-5fea-588b-b8a7-5cc4900324e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2228339,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_3ede407a60e767b8f9a1d35648c5d882.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e14e728-5fea-588b-b8a7-5cc4900324e0/1e14e728-5fea-588b-b8a7-5cc4900324e0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_de670633fbe6b17eef19d70054b36a2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e14e728-5fea-588b-b8a7-5cc4900324e0/1e14e728-5fea-588b-b8a7-5cc4900324e0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_23e2a5be2fa6db57bd7bbd7a5b58d573.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e14e728-5fea-588b-b8a7-5cc4900324e0/1e14e728-5fea-588b-b8a7-5cc4900324e0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2795378,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_27bfac18e3534725eea33772c1817541.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e14e728-5fea-588b-b8a7-5cc4900324e0/1e14e728-5fea-588b-b8a7-5cc4900324e0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2385324,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/75/d9757709bf7a231ebc8d301fa2ba2898/pa/JV33372_1b7762ae2022c5d931820d96e7203d6c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2019}
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV33372%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [auto1.it] INFO: Saving data for JV33372: {'created_time': 1774861262.53785, 'last_price_update_time': 1774861262.537861, 'auction_closing_time': 1774970137.0}
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JV33372') HTTP/1.1" 204 0
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: GS61581
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS61581%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [auto1.it] INFO: Scrape type for GS61581: 0
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: XR52700
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: XR36455
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR36455%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [auto1.it] INFO: Scrape type for XR36455: 1
2026-03-30 09:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ43487> (referer: https://www.auto1.com/v1/car-details-view/UZ43487/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: VE63363
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: ZR86104
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: GV71970
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV71970%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [auto1.it] INFO: Scrape type for GV71970: 1
2026-03-30 09:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR04366/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4509fd91-d60a-517e-a196-7566eeb8ca80 with identifier: BE54405
2026-03-30 09:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4509fd91-d60a-517e-a196-7566eeb8ca80 with scrape type 1
2026-03-30 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4509fd91-d60a-517e-a196-7566eeb8ca80
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_3da492bc58efa0452b46889422a4d757.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_3da492bc58efa0452b46889422a4d757.jpg not downloaded yet
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: YV17911
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: AL80929
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: ZH19388
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH19388%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [auto1.it] INFO: Scrape type for ZH19388: 1
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_7aef6c99c886dad5e87054c83d5e4519.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_7aef6c99c886dad5e87054c83d5e4519.jpg not downloaded yet
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: UF13738
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: RC10955
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: ZE75759
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: RA18546
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: FM86422
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: PW67312
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: KA76603
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: DA30561
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: UW57613
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW57613%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [auto1.it] INFO: Scrape type for UW57613: 1
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_89a0ae39d9a1886a51e6cb6cf1549613.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_89a0ae39d9a1886a51e6cb6cf1549613.jpg not downloaded yet
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: KJ64307
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: FL99970
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL99970%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [auto1.it] INFO: Scrape type for FL99970: 1
2026-03-30 09:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac659857-c0fc-5db7-9aa6-6fd7942fcf42 with identifier: UZ43487
2026-03-30 09:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42 with scrape type 1
2026-03-30 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_4d80561e3d0da28bcc6495c864ec1c39.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_4d80561e3d0da28bcc6495c864ec1c39.jpg not downloaded yet
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_63e2a7d8c65ec2be4117684e7f9557bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_63e2a7d8c65ec2be4117684e7f9557bf.jpg not downloaded yet
2026-03-30 09:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_3da492bc58efa0452b46889422a4d757.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:02 [auto1.it] INFO: Found listing with ID: NF28136
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF28136%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [auto1.it] INFO: Scrape type for NF28136: 2
2026-03-30 09:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf055ff-5338-5653-8440-bb65c7bbcbc5 with identifier: NF28136
2026-03-30 09:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf055ff-5338-5653-8440-bb65c7bbcbc5 with scrape type 2
2026-03-30 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daf055ff-5338-5653-8440-bb65c7bbcbc5 with scrape type 2
2026-03-30 09:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: daf055ff-5338-5653-8440-bb65c7bbcbc5, identifier: NF28136
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_883149e87c32018516e2eaa1698ece3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_883149e87c32018516e2eaa1698ece3a.jpg not downloaded yet
2026-03-30 09:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: daf055ff-5338-5653-8440-bb65c7bbcbc5 with identifier: NF28136
2026-03-30 09:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: daf055ff-5338-5653-8440-bb65c7bbcbc5 with identifier: NF28136
2026-03-30 09:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: daf055ff-5338-5653-8440-bb65c7bbcbc5 with identifier: NF28136 to the API
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:45:41Z',
 'fuel_type': 'diesel',
 'id': 'daf055ff-5338-5653-8440-bb65c7bbcbc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF28136',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 104021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-27',
 'seller_name': None,
 'title': 'Jaguar E-Pace D180 S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2017}
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF28136%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [auto1.it] INFO: Saving data for NF28136: {'auction_closing_time': 1774971941.0, 'created_time': 1774645447.203124, 'last_price_update_time': 1774861263.378955}
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF28136') HTTP/1.1" 204 0
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_587c89b8e57a007f4ce9ee3ffdd11cf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_587c89b8e57a007f4ce9ee3ffdd11cf3.jpg not downloaded yet
2026-03-30 09:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_7aef6c99c886dad5e87054c83d5e4519.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:03 [auto1.it] INFO: Found listing with ID: BB99358
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB99358%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [auto1.it] INFO: Scrape type for BB99358: 1
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_bba8dd8c052f928c2a1ee77515115b90.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_bba8dd8c052f928c2a1ee77515115b90.jpg not downloaded yet
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_f97ccbe064c2c23db71efee8f7ced5f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_f97ccbe064c2c23db71efee8f7ced5f2.jpg not downloaded yet
2026-03-30 09:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0624b250>
2026-03-30 09:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_3da492bc58efa0452b46889422a4d757.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_3da492bc58efa0452b46889422a4d757.jpg saved to cache
2026-03-30 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4509fd91-d60a-517e-a196-7566eeb8ca80
2026-03-30 09:01:03 [auto1.it] INFO: Found listing with ID: BW52092
2026-03-30 09:01:03 [auto1.it] INFO: Found listing with ID: CF64613
2026-03-30 09:01:03 [auto1.it] INFO: Found listing with ID: TF93411
2026-03-30 09:01:03 [auto1.it] INFO: Found listing with ID: LX38912
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX38912%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [auto1.it] INFO: Scrape type for LX38912: 1
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_18ed3d7467c087011c6c444a9869d63b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_18ed3d7467c087011c6c444a9869d63b.jpg not downloaded yet
2026-03-30 09:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP93203> (referer: https://www.auto1.com/v1/car-details-view/DP93203/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX80167> (referer: https://www.auto1.com/v1/car-details-view/TX80167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_4d80561e3d0da28bcc6495c864ec1c39.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_520db8ae6e42cd6093f3437d9a4ab3f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_520db8ae6e42cd6093f3437d9a4ab3f8.jpg not downloaded yet
2026-03-30 09:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:03 [auto1.it] INFO: Found listing with ID: JZ25588
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ25588%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [auto1.it] INFO: Scrape type for JZ25588: 1
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_0c2f5ed97729a8eb67463709455e6370.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_0c2f5ed97729a8eb67463709455e6370.jpg not downloaded yet
2026-03-30 09:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD37859> (referer: https://www.auto1.com/v1/car-details-view/AD37859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d3d750>
2026-03-30 09:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_7aef6c99c886dad5e87054c83d5e4519.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_7aef6c99c886dad5e87054c83d5e4519.jpg saved to cache
2026-03-30 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4509fd91-d60a-517e-a196-7566eeb8ca80
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_e55520c54f08df50bfcf6bfd9bbd0947.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_e55520c54f08df50bfcf6bfd9bbd0947.jpg not downloaded yet
2026-03-30 09:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_587c89b8e57a007f4ce9ee3ffdd11cf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:03 [auto1.it] INFO: Found listing with ID: YU05925
2026-03-30 09:01:03 [auto1.it] INFO: Found listing with ID: MA72760
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA72760%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [auto1.it] INFO: Scrape type for MA72760: 1
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_43682b3fee23ed9a5dec83a275454d8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_43682b3fee23ed9a5dec83a275454d8b.jpg not downloaded yet
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_4f8fd3838d6133799d9f0fa787cea2ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_4f8fd3838d6133799d9f0fa787cea2ec.jpg not downloaded yet
2026-03-30 09:01:03 [auto1.it] INFO: Found listing with ID: EC41125
2026-03-30 09:01:03 [auto1.it] INFO: Found listing with ID: JU77686
2026-03-30 09:01:03 [auto1.it] INFO: Found listing with ID: YM60630
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM60630%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [auto1.it] INFO: Scrape type for YM60630: 1
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_40aa1072fc2af8849685b457c7e7d2e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_40aa1072fc2af8849685b457c7e7d2e6.jpg not downloaded yet
2026-03-30 09:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_bba8dd8c052f928c2a1ee77515115b90.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:04 [scrapy.extensions.logstats] INFO: Crawled 64 pages (at 64 pages/min), scraped 30 items (at 30 items/min)
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_2f616bd20fca91cd373d7cd46876daa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_2f616bd20fca91cd373d7cd46876daa9.jpg not downloaded yet
2026-03-30 09:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6774c04b-8b8a-5da1-ab3d-291bf0391fe1 with identifier: DP93203
2026-03-30 09:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6774c04b-8b8a-5da1-ab3d-291bf0391fe1 with scrape type 1
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6774c04b-8b8a-5da1-ab3d-291bf0391fe1
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F92%252F5f920d05e0ee3bd323e438b87c6ed6e1%252Fpa%252FDP93203_1869916f1bcba20dfd8f4fd235561e3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_1869916f1bcba20dfd8f4fd235561e3a.jpg not downloaded yet
2026-03-30 09:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9 with identifier: TX80167
2026-03-30 09:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9 with scrape type 1
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F32%252F793261912116f19bcabfea47eed89349%252Fpa%252FTX80167_2c1ded33e73233368e5eadeeacbbb527.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_2c1ded33e73233368e5eadeeacbbb527.jpg not downloaded yet
2026-03-30 09:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0dde55d0>
2026-03-30 09:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_4d80561e3d0da28bcc6495c864ec1c39.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_4d80561e3d0da28bcc6495c864ec1c39.jpg saved to cache
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42
2026-03-30 09:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0111fab5-206d-5b8b-b400-49b41be7ccfc with identifier: AD37859
2026-03-30 09:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0111fab5-206d-5b8b-b400-49b41be7ccfc with scrape type 1
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0111fab5-206d-5b8b-b400-49b41be7ccfc
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fc9%252Ff1c960b581479c9cf55375564600d2d9%252Fpa%252FAD37859_3b97c14238b34dfca5c13f8f67b5d16e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_3b97c14238b34dfca5c13f8f67b5d16e.jpg not downloaded yet
2026-03-30 09:01:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 197MiB
2026-03-30 09:01:04 [auto1.it] INFO: Found listing with ID: AL20589
2026-03-30 09:01:04 [auto1.it] INFO: Found listing with ID: CF41480
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF41480%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [auto1.it] INFO: Scrape type for CF41480: 1
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_e3bd5ee747b2c59914250382b222ea64.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_e3bd5ee747b2c59914250382b222ea64.jpg not downloaded yet
2026-03-30 09:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_f97ccbe064c2c23db71efee8f7ced5f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F92%252F5f920d05e0ee3bd323e438b87c6ed6e1%252Fpa%252FDP93203_938e5087508a21e19741e9aba08b3a52.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_938e5087508a21e19741e9aba08b3a52.jpg not downloaded yet
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F32%252F793261912116f19bcabfea47eed89349%252Fpa%252FTX80167_38e6c22bae04048d5f70e729a6fee164.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_38e6c22bae04048d5f70e729a6fee164.jpg not downloaded yet
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fc9%252Ff1c960b581479c9cf55375564600d2d9%252Fpa%252FAD37859_040bd3f641bd095f260157ed1bfbf2f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_040bd3f641bd095f260157ed1bfbf2f8.jpg not downloaded yet
2026-03-30 09:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_0c2f5ed97729a8eb67463709455e6370.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:04 [auto1.it] INFO: Found listing with ID: MR16221
2026-03-30 09:01:04 [auto1.it] INFO: Found listing with ID: MZ19465
2026-03-30 09:01:04 [auto1.it] INFO: Found listing with ID: KL21440
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL21440%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [auto1.it] INFO: Scrape type for KL21440: 1
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_864a15b64acb08e46d1a2d3d520c2161.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_864a15b64acb08e46d1a2d3d520c2161.jpg not downloaded yet
2026-03-30 09:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ce9c50>
2026-03-30 09:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_587c89b8e57a007f4ce9ee3ffdd11cf3.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_587c89b8e57a007f4ce9ee3ffdd11cf3.jpg saved to cache
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4509fd91-d60a-517e-a196-7566eeb8ca80
2026-03-30 09:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062bf1d0>
2026-03-30 09:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_bba8dd8c052f928c2a1ee77515115b90.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_bba8dd8c052f928c2a1ee77515115b90.jpg saved to cache
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42
2026-03-30 09:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_4f8fd3838d6133799d9f0fa787cea2ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F92%252F5f920d05e0ee3bd323e438b87c6ed6e1%252Fpa%252FDP93203_bd1ae7ca6e98badb849a1e98883cbafd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_bd1ae7ca6e98badb849a1e98883cbafd.jpg not downloaded yet
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F32%252F793261912116f19bcabfea47eed89349%252Fpa%252FTX80167_c8d899e8595a56be55e9e23d7203eaa4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_c8d899e8595a56be55e9e23d7203eaa4.jpg not downloaded yet
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fc9%252Ff1c960b581479c9cf55375564600d2d9%252Fpa%252FAD37859_8b968e533c29467b8398a457ed4a0d2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_8b968e533c29467b8398a457ed4a0d2f.jpg not downloaded yet
2026-03-30 09:01:04 [auto1.it] INFO: Found listing with ID: XJ15185
2026-03-30 09:01:04 [auto1.it] INFO: Found listing with ID: FW53113
2026-03-30 09:01:04 [auto1.it] INFO: Found listing with ID: AX14141
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX14141%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [auto1.it] INFO: Scrape type for AX14141: 2
2026-03-30 09:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d840164-237c-5a06-8954-b09f60f2656b with identifier: AX14141
2026-03-30 09:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d840164-237c-5a06-8954-b09f60f2656b with scrape type 2
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d840164-237c-5a06-8954-b09f60f2656b with scrape type 2
2026-03-30 09:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d840164-237c-5a06-8954-b09f60f2656b, identifier: AX14141
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_56581ece71ce71579502cebc19c3bd0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_56581ece71ce71579502cebc19c3bd0a.jpg not downloaded yet
2026-03-30 09:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d840164-237c-5a06-8954-b09f60f2656b with identifier: AX14141
2026-03-30 09:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d840164-237c-5a06-8954-b09f60f2656b with identifier: AX14141
2026-03-30 09:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d840164-237c-5a06-8954-b09f60f2656b with identifier: AX14141 to the API
2026-03-30 09:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:55:49Z',
 'fuel_type': 'diesel',
 'id': '9d840164-237c-5a06-8954-b09f60f2656b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX14141',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 175961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-27',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX14141%27 HTTP/1.1" 200 None
2026-03-30 09:01:05 [auto1.it] INFO: Saving data for AX14141: {'auction_closing_time': 1774972549.0, 'created_time': 1774645449.622869, 'last_price_update_time': 1774861265.655611}
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AX14141') HTTP/1.1" 204 0
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F92%252F5f920d05e0ee3bd323e438b87c6ed6e1%252Fpa%252FDP93203_f2c03bfcc814055128e56141bc110a11.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_f2c03bfcc814055128e56141bc110a11.jpg not downloaded yet
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F32%252F793261912116f19bcabfea47eed89349%252Fpa%252FTX80167_b54cc62994a76e31a83179e29d3c65a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_b54cc62994a76e31a83179e29d3c65a9.jpg not downloaded yet
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fc9%252Ff1c960b581479c9cf55375564600d2d9%252Fpa%252FAD37859_32aa452798c564c59149a7d122da6799.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_32aa452798c564c59149a7d122da6799.jpg not downloaded yet
2026-03-30 09:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT13926> (referer: https://www.auto1.com/v1/car-details-view/BT13926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fcf550>
2026-03-30 09:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_f97ccbe064c2c23db71efee8f7ced5f2.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_f97ccbe064c2c23db71efee8f7ced5f2.jpg saved to cache
2026-03-30 09:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4509fd91-d60a-517e-a196-7566eeb8ca80
2026-03-30 09:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e7b650>
2026-03-30 09:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_0c2f5ed97729a8eb67463709455e6370.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_0c2f5ed97729a8eb67463709455e6370.jpg saved to cache
2026-03-30 09:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42
2026-03-30 09:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F92%252F5f920d05e0ee3bd323e438b87c6ed6e1%252Fpa%252FDP93203_eea776690d296d68bf6e778d138d053c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_eea776690d296d68bf6e778d138d053c.jpg not downloaded yet
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F32%252F793261912116f19bcabfea47eed89349%252Fpa%252FTX80167_0559b7ce8175dd0ac917ff22dd723aa2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_0559b7ce8175dd0ac917ff22dd723aa2.jpg not downloaded yet
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fc9%252Ff1c960b581479c9cf55375564600d2d9%252Fpa%252FAD37859_7c03259bf677d848e1fe9c8c6d3b5068.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_7c03259bf677d848e1fe9c8c6d3b5068.jpg not downloaded yet
2026-03-30 09:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH19388/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd6a50>
2026-03-30 09:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_4f8fd3838d6133799d9f0fa787cea2ec.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_4f8fd3838d6133799d9f0fa787cea2ec.jpg saved to cache
2026-03-30 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4509fd91-d60a-517e-a196-7566eeb8ca80
2026-03-30 09:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_040bd3f641bd095f260157ed1bfbf2f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_e3bd5ee747b2c59914250382b222ea64.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV71970/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:06 [auto1.it] INFO: Channel: 24h | Page: 4 | totalHits: 3284 | hits on page: 40
2026-03-30 09:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_8b968e533c29467b8398a457ed4a0d2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:06 [auto1.it] INFO: Found listing with ID: NB05481
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB05481%27 HTTP/1.1" 200 None
2026-03-30 09:01:06 [auto1.it] INFO: Scrape type for NB05481: 1
2026-03-30 09:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec49e752-eb4e-520f-bcc4-2192930184ac with identifier: BT13926
2026-03-30 09:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec49e752-eb4e-520f-bcc4-2192930184ac with scrape type 1
2026-03-30 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec49e752-eb4e-520f-bcc4-2192930184ac
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F53%252Fe553ee6dd36757db2a072d7fcbfa45ec%252Fpa%252FBT13926_11cdf448b9cbd5a28add34d15112d53f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_11cdf448b9cbd5a28add34d15112d53f.jpg already downloaded
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F53%252Fe553ee6dd36757db2a072d7fcbfa45ec%252Fpa%252FBT13926_40f37b910463e100a53a5a33c4a54cdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_40f37b910463e100a53a5a33c4a54cdb.jpg already downloaded
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F53%252Fe553ee6dd36757db2a072d7fcbfa45ec%252Fpa%252FBT13926_e8ecc9d3cb3fd90f394994a82781de79.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_e8ecc9d3cb3fd90f394994a82781de79.jpg already downloaded
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F53%252Fe553ee6dd36757db2a072d7fcbfa45ec%252Fpa%252FBT13926_0a124c7549a8029b478d6739a76ec7cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_0a124c7549a8029b478d6739a76ec7cd.jpg already downloaded
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F53%252Fe553ee6dd36757db2a072d7fcbfa45ec%252Fpa%252FBT13926_d48603d7bfb4590b5d2d29e0fc25a0b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d48603d7bfb4590b5d2d29e0fc25a0b1.jpg already downloaded
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F53%252Fe553ee6dd36757db2a072d7fcbfa45ec%252Fpa%252FBT13926_7aa8f15bc6ca1d9d16601b39d08c2963.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_7aa8f15bc6ca1d9d16601b39d08c2963.jpg already downloaded
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F53%252Fe553ee6dd36757db2a072d7fcbfa45ec%252Fpa%252FBT13926_8c493201903734796c9bdb1623190db6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_8c493201903734796c9bdb1623190db6.jpg already downloaded
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F53%252Fe553ee6dd36757db2a072d7fcbfa45ec%252Fpa%252FBT13926_dd0351c6b62849798a2be9966df9f769.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_dd0351c6b62849798a2be9966df9f769.jpg already downloaded
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F53%252Fe553ee6dd36757db2a072d7fcbfa45ec%252Fpa%252FBT13926_72695348874e260c424a0f86bb289bbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_72695348874e260c424a0f86bb289bbb.jpg already downloaded
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F53%252Fe553ee6dd36757db2a072d7fcbfa45ec%252Fpa%252FBT13926_d2887e03ec577f14ca2603f69ddaf081.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d2887e03ec577f14ca2603f69ddaf081.jpg already downloaded
2026-03-30 09:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ec49e752-eb4e-520f-bcc4-2192930184ac, identifier: BT13926
2026-03-30 09:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ec49e752-eb4e-520f-bcc4-2192930184ac with identifier: BT13926
2026-03-30 09:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ec49e752-eb4e-520f-bcc4-2192930184ac with identifier: BT13926
2026-03-30 09:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ec49e752-eb4e-520f-bcc4-2192930184ac with identifier: BT13926 to the API
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BT13926>
{'auction_title': '',
 'c_o_2_emission_value': 26,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:14:31Z',
 'fuel_type': 'hybrid',
 'id': 'ec49e752-eb4e-520f-bcc4-2192930184ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT13926',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 57408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_11cdf448b9cbd5a28add34d15112d53f.jpg',
                'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_40f37b910463e100a53a5a33c4a54cdb.jpg',
                'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_e8ecc9d3cb3fd90f394994a82781de79.jpg',
                'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_0a124c7549a8029b478d6739a76ec7cd.jpg',
                'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d48603d7bfb4590b5d2d29e0fc25a0b1.jpg',
                'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_7aa8f15bc6ca1d9d16601b39d08c2963.jpg',
                'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_8c493201903734796c9bdb1623190db6.jpg',
                'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_dd0351c6b62849798a2be9966df9f769.jpg',
                'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_72695348874e260c424a0f86bb289bbb.jpg',
                'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d2887e03ec577f14ca2603f69ddaf081.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_11cdf448b9cbd5a28add34d15112d53f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_40f37b910463e100a53a5a33c4a54cdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_e8ecc9d3cb3fd90f394994a82781de79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_0a124c7549a8029b478d6739a76ec7cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d48603d7bfb4590b5d2d29e0fc25a0b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_7aa8f15bc6ca1d9d16601b39d08c2963.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_8c493201903734796c9bdb1623190db6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_dd0351c6b62849798a2be9966df9f769.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_72695348874e260c424a0f86bb289bbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d2887e03ec577f14ca2603f69ddaf081.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2020}
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT13926%27 HTTP/1.1" 200 None
2026-03-30 09:01:06 [auto1.it] INFO: Saving data for BT13926: {'created_time': 1774861266.980498, 'last_price_update_time': 1774861266.980509, 'auction_closing_time': 1774970071.0}
2026-03-30 09:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BT13926') HTTP/1.1" 204 0
2026-03-30 09:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_08bfd94c12ba1570c608f034603baabe.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_56581ece71ce71579502cebc19c3bd0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_b54cc62994a76e31a83179e29d3c65a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:07 [auto1.it] INFO: Found listing with ID: CW23076
2026-03-30 09:01:07 [auto1.it] INFO: Found listing with ID: PP58760
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP58760%27 HTTP/1.1" 200 None
2026-03-30 09:01:07 [auto1.it] INFO: Scrape type for PP58760: 2
2026-03-30 09:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40cbd070-23ab-58f2-8c95-b38477683453 with identifier: PP58760
2026-03-30 09:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40cbd070-23ab-58f2-8c95-b38477683453 with scrape type 2
2026-03-30 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40cbd070-23ab-58f2-8c95-b38477683453 with scrape type 2
2026-03-30 09:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 40cbd070-23ab-58f2-8c95-b38477683453, identifier: PP58760
2026-03-30 09:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_32aa452798c564c59149a7d122da6799.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 40cbd070-23ab-58f2-8c95-b38477683453 with identifier: PP58760
2026-03-30 09:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 40cbd070-23ab-58f2-8c95-b38477683453 with identifier: PP58760
2026-03-30 09:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 40cbd070-23ab-58f2-8c95-b38477683453 with identifier: PP58760 to the API
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:16:04Z',
 'fuel_type': 'diesel',
 'id': '40cbd070-23ab-58f2-8c95-b38477683453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP58760',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 128187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-04',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP58760%27 HTTP/1.1" 200 None
2026-03-30 09:01:07 [auto1.it] INFO: Saving data for PP58760: {'auction_closing_time': 1774970164.0, 'created_time': 1772783849.854134, 'last_price_update_time': 1774861267.873362}
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PP58760') HTTP/1.1" 204 0
2026-03-30 09:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_f2c03bfcc814055128e56141bc110a11.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:07 [auto1.it] INFO: Found listing with ID: DW47560
2026-03-30 09:01:07 [auto1.it] INFO: Found listing with ID: UB63640
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB63640%27 HTTP/1.1" 200 None
2026-03-30 09:01:07 [auto1.it] INFO: Scrape type for UB63640: 1
2026-03-30 09:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB99358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062a1fd0>
2026-03-30 09:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0111fab5-206d-5b8b-b400-49b41be7ccfc/0111fab5-206d-5b8b-b400-49b41be7ccfc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fc9%252Ff1c960b581479c9cf55375564600d2d9%252Fpa%252FAD37859_040bd3f641bd095f260157ed1bfbf2f8.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_040bd3f641bd095f260157ed1bfbf2f8.jpg saved to cache
2026-03-30 09:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0111fab5-206d-5b8b-b400-49b41be7ccfc
2026-03-30 09:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f4da10>
2026-03-30 09:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_e3bd5ee747b2c59914250382b222ea64.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_e3bd5ee747b2c59914250382b222ea64.jpg saved to cache
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c95690>
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0111fab5-206d-5b8b-b400-49b41be7ccfc/0111fab5-206d-5b8b-b400-49b41be7ccfc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fc9%252Ff1c960b581479c9cf55375564600d2d9%252Fpa%252FAD37859_8b968e533c29467b8398a457ed4a0d2f.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_8b968e533c29467b8398a457ed4a0d2f.jpg saved to cache
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0111fab5-206d-5b8b-b400-49b41be7ccfc
2026-03-30 09:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD15885> (referer: https://www.auto1.com/v1/car-details-view/ZD15885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_0559b7ce8175dd0ac917ff22dd723aa2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_eea776690d296d68bf6e778d138d053c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_7c03259bf677d848e1fe9c8c6d3b5068.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:08 [auto1.it] INFO: Found listing with ID: SY30215
2026-03-30 09:01:08 [auto1.it] INFO: Found listing with ID: GM45638
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM45638%27 HTTP/1.1" 200 None
2026-03-30 09:01:08 [auto1.it] INFO: Scrape type for GM45638: 1
2026-03-30 09:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c90f10>
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_08bfd94c12ba1570c608f034603baabe.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_08bfd94c12ba1570c608f034603baabe.jpg saved to cache
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb2ef62d-81fd-55da-a334-042e161f797a
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06397f10>
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_56581ece71ce71579502cebc19c3bd0a.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_56581ece71ce71579502cebc19c3bd0a.jpg saved to cache
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062bff10>
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59cfabbb-5ae0-5a2d-a230-cac57f32ebb9/59cfabbb-5ae0-5a2d-a230-cac57f32ebb9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F32%252F793261912116f19bcabfea47eed89349%252Fpa%252FTX80167_b54cc62994a76e31a83179e29d3c65a9.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_b54cc62994a76e31a83179e29d3c65a9.jpg saved to cache
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06396090>
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0111fab5-206d-5b8b-b400-49b41be7ccfc/0111fab5-206d-5b8b-b400-49b41be7ccfc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fc9%252Ff1c960b581479c9cf55375564600d2d9%252Fpa%252FAD37859_32aa452798c564c59149a7d122da6799.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_32aa452798c564c59149a7d122da6799.jpg saved to cache
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0111fab5-206d-5b8b-b400-49b41be7ccfc
2026-03-30 09:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_c8d899e8595a56be55e9e23d7203eaa4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:08 [auto1.it] INFO: Found listing with ID: LA34369
2026-03-30 09:01:08 [auto1.it] INFO: Found listing with ID: KB21733
2026-03-30 09:01:08 [auto1.it] INFO: Found listing with ID: ZZ37544
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ37544%27 HTTP/1.1" 200 None
2026-03-30 09:01:08 [auto1.it] INFO: Scrape type for ZZ37544: 1
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0c465dd0>
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6774c04b-8b8a-5da1-ab3d-291bf0391fe1/6774c04b-8b8a-5da1-ab3d-291bf0391fe1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F92%252F5f920d05e0ee3bd323e438b87c6ed6e1%252Fpa%252FDP93203_f2c03bfcc814055128e56141bc110a11.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_f2c03bfcc814055128e56141bc110a11.jpg saved to cache
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6774c04b-8b8a-5da1-ab3d-291bf0391fe1
2026-03-30 09:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99ac4d2d-fd47-5647-9976-5b828662c9b7 with identifier: ZD15885
2026-03-30 09:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99ac4d2d-fd47-5647-9976-5b828662c9b7 with scrape type 1
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 99ac4d2d-fd47-5647-9976-5b828662c9b7
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd8%252Fd6d8ff20b3cfbff3dd5fe4c199d11bf1%252Fpa%252FZD15885_e2f8aeb27253ce0b3004e144f3173e36.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_e2f8aeb27253ce0b3004e144f3173e36.jpg already downloaded
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd8%252Fd6d8ff20b3cfbff3dd5fe4c199d11bf1%252Fpa%252FZD15885_ae72485b414726ce189c3c832f496a01.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_ae72485b414726ce189c3c832f496a01.jpg already downloaded
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd8%252Fd6d8ff20b3cfbff3dd5fe4c199d11bf1%252Fpa%252FZD15885_f5887646ce350b5d89b6ab3781075825.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_f5887646ce350b5d89b6ab3781075825.jpg already downloaded
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd8%252Fd6d8ff20b3cfbff3dd5fe4c199d11bf1%252Fpa%252FZD15885_eb63f0ceebfbde13f88baa7acf5062d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_eb63f0ceebfbde13f88baa7acf5062d8.jpg already downloaded
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fd8%252Fd6d8ff20b3cfbff3dd5fe4c199d11bf1%252Fpa%252FZD15885_67d9e7fca4b710e23517ade1a8c4fc7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_67d9e7fca4b710e23517ade1a8c4fc7b.jpg already downloaded
2026-03-30 09:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 99ac4d2d-fd47-5647-9976-5b828662c9b7, identifier: ZD15885
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063c6590>
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59cfabbb-5ae0-5a2d-a230-cac57f32ebb9/59cfabbb-5ae0-5a2d-a230-cac57f32ebb9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F32%252F793261912116f19bcabfea47eed89349%252Fpa%252FTX80167_0559b7ce8175dd0ac917ff22dd723aa2.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_0559b7ce8175dd0ac917ff22dd723aa2.jpg saved to cache
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063f8050>
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6774c04b-8b8a-5da1-ab3d-291bf0391fe1/6774c04b-8b8a-5da1-ab3d-291bf0391fe1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F92%252F5f920d05e0ee3bd323e438b87c6ed6e1%252Fpa%252FDP93203_eea776690d296d68bf6e778d138d053c.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_eea776690d296d68bf6e778d138d053c.jpg saved to cache
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6774c04b-8b8a-5da1-ab3d-291bf0391fe1
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c31990>
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0111fab5-206d-5b8b-b400-49b41be7ccfc/0111fab5-206d-5b8b-b400-49b41be7ccfc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fc9%252Ff1c960b581479c9cf55375564600d2d9%252Fpa%252FAD37859_7c03259bf677d848e1fe9c8c6d3b5068.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_7c03259bf677d848e1fe9c8c6d3b5068.jpg saved to cache
2026-03-30 09:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0111fab5-206d-5b8b-b400-49b41be7ccfc
2026-03-30 09:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_82239a63ef329484dc61762e49fdfbcc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:08 [auto1.it] INFO: Found listing with ID: HP37847
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP37847%27 HTTP/1.1" 200 None
2026-03-30 09:01:08 [auto1.it] INFO: Scrape type for HP37847: 1
2026-03-30 09:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 99ac4d2d-fd47-5647-9976-5b828662c9b7 with identifier: ZD15885
2026-03-30 09:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 99ac4d2d-fd47-5647-9976-5b828662c9b7 with identifier: ZD15885
2026-03-30 09:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 99ac4d2d-fd47-5647-9976-5b828662c9b7 with identifier: ZD15885 to the API
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZD15885>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:30:54Z',
 'fuel_type': 'petrol',
 'id': '99ac4d2d-fd47-5647-9976-5b828662c9b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD15885',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 155098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_e2f8aeb27253ce0b3004e144f3173e36.jpg',
                'https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_ae72485b414726ce189c3c832f496a01.jpg',
                'https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_f5887646ce350b5d89b6ab3781075825.jpg',
                'https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_eb63f0ceebfbde13f88baa7acf5062d8.jpg',
                'https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_67d9e7fca4b710e23517ade1a8c4fc7b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ac4d2d-fd47-5647-9976-5b828662c9b7/99ac4d2d-fd47-5647-9976-5b828662c9b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_e2f8aeb27253ce0b3004e144f3173e36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ac4d2d-fd47-5647-9976-5b828662c9b7/99ac4d2d-fd47-5647-9976-5b828662c9b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_ae72485b414726ce189c3c832f496a01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ac4d2d-fd47-5647-9976-5b828662c9b7/99ac4d2d-fd47-5647-9976-5b828662c9b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_f5887646ce350b5d89b6ab3781075825.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ac4d2d-fd47-5647-9976-5b828662c9b7/99ac4d2d-fd47-5647-9976-5b828662c9b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_eb63f0ceebfbde13f88baa7acf5062d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99ac4d2d-fd47-5647-9976-5b828662c9b7/99ac4d2d-fd47-5647-9976-5b828662c9b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/d8/d6d8ff20b3cfbff3dd5fe4c199d11bf1/pa/ZD15885_67d9e7fca4b710e23517ade1a8c4fc7b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2009}
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD15885%27 HTTP/1.1" 200 None
2026-03-30 09:01:09 [auto1.it] INFO: Saving data for ZD15885: {'created_time': 1774861269.348902, 'last_price_update_time': 1774861269.348917, 'auction_closing_time': 1774971054.0}
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZD15885') HTTP/1.1" 204 0
2026-03-30 09:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_bd1ae7ca6e98badb849a1e98883cbafd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_864a15b64acb08e46d1a2d3d520c2161.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:09 [auto1.it] INFO: Found listing with ID: FK67266
2026-03-30 09:01:09 [auto1.it] INFO: Found listing with ID: AH42786
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH42786%27 HTTP/1.1" 200 None
2026-03-30 09:01:09 [auto1.it] INFO: Scrape type for AH42786: 1
2026-03-30 09:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB05481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF41480/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0628d3d0>
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59cfabbb-5ae0-5a2d-a230-cac57f32ebb9/59cfabbb-5ae0-5a2d-a230-cac57f32ebb9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F32%252F793261912116f19bcabfea47eed89349%252Fpa%252FTX80167_c8d899e8595a56be55e9e23d7203eaa4.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_c8d899e8595a56be55e9e23d7203eaa4.jpg saved to cache
2026-03-30 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9
2026-03-30 09:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:09 [auto1.it] INFO: Found listing with ID: RV38017
2026-03-30 09:01:09 [auto1.it] INFO: Found listing with ID: JK64224
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK64224%27 HTTP/1.1" 200 None
2026-03-30 09:01:09 [auto1.it] INFO: Scrape type for JK64224: 1
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06da4a10>
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_82239a63ef329484dc61762e49fdfbcc.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_82239a63ef329484dc61762e49fdfbcc.jpg saved to cache
2026-03-30 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb2ef62d-81fd-55da-a334-042e161f797a
2026-03-30 09:01:09 [auto1.it] INFO: Found listing with ID: CL10517
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL10517%27 HTTP/1.1" 200 None
2026-03-30 09:01:09 [auto1.it] INFO: Scrape type for CL10517: 1
2026-03-30 09:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_eeb9adebb7f53d8615b218a7f08f485d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f4f710>
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6774c04b-8b8a-5da1-ab3d-291bf0391fe1/6774c04b-8b8a-5da1-ab3d-291bf0391fe1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F92%252F5f920d05e0ee3bd323e438b87c6ed6e1%252Fpa%252FDP93203_bd1ae7ca6e98badb849a1e98883cbafd.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_bd1ae7ca6e98badb849a1e98883cbafd.jpg saved to cache
2026-03-30 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6774c04b-8b8a-5da1-ab3d-291bf0391fe1
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c9c490>
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_864a15b64acb08e46d1a2d3d520c2161.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_864a15b64acb08e46d1a2d3d520c2161.jpg saved to cache
2026-03-30 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42
2026-03-30 09:01:09 [auto1.it] INFO: Channel: 24h | Page: 5 | totalHits: 3284 | hits on page: 40
2026-03-30 09:01:09 [auto1.it] INFO: Found listing with ID: BK72599
2026-03-30 09:01:09 [auto1.it] INFO: Found listing with ID: NP53767
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP53767%27 HTTP/1.1" 200 None
2026-03-30 09:01:09 [auto1.it] INFO: Scrape type for NP53767: 1
2026-03-30 09:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_3b97c14238b34dfca5c13f8f67b5d16e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:09 [auto1.it] INFO: Found listing with ID: WY43100
2026-03-30 09:01:09 [auto1.it] INFO: Found listing with ID: FF00000
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF00000%27 HTTP/1.1" 200 None
2026-03-30 09:01:09 [auto1.it] INFO: Scrape type for FF00000: 2
2026-03-30 09:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 269d3bf5-243e-5de1-a8c4-f582655074fc with identifier: FF00000
2026-03-30 09:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 269d3bf5-243e-5de1-a8c4-f582655074fc with scrape type 2
2026-03-30 09:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 269d3bf5-243e-5de1-a8c4-f582655074fc with scrape type 2
2026-03-30 09:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 269d3bf5-243e-5de1-a8c4-f582655074fc, identifier: FF00000
2026-03-30 09:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_938e5087508a21e19741e9aba08b3a52.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_38e6c22bae04048d5f70e729a6fee164.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:10 [auto1.it] INFO: Found listing with ID: PZ28359
2026-03-30 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ28359%27 HTTP/1.1" 200 None
2026-03-30 09:01:10 [auto1.it] INFO: Scrape type for PZ28359: 2
2026-03-30 09:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541f9e52-6c53-54b7-bbad-4822c03ff5ab with identifier: PZ28359
2026-03-30 09:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541f9e52-6c53-54b7-bbad-4822c03ff5ab with scrape type 2
2026-03-30 09:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 541f9e52-6c53-54b7-bbad-4822c03ff5ab with scrape type 2
2026-03-30 09:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 541f9e52-6c53-54b7-bbad-4822c03ff5ab, identifier: PZ28359
2026-03-30 09:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 269d3bf5-243e-5de1-a8c4-f582655074fc with identifier: FF00000
2026-03-30 09:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 269d3bf5-243e-5de1-a8c4-f582655074fc with identifier: FF00000
2026-03-30 09:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 269d3bf5-243e-5de1-a8c4-f582655074fc with identifier: FF00000 to the API
2026-03-30 09:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 188,
 'expiration_date': '2026-03-31T15:34:24Z',
 'fuel_type': 'hybrid',
 'id': '269d3bf5-243e-5de1-a8c4-f582655074fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF00000',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 57346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-21',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'Instyle 4WD',
 'year': 2022}
2026-03-30 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF00000%27 HTTP/1.1" 200 None
2026-03-30 09:01:10 [auto1.it] INFO: Saving data for FF00000: {'auction_closing_time': 1774971264.0, 'created_time': 1774002035.703357, 'last_price_update_time': 1774861270.592544}
2026-03-30 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FF00000') HTTP/1.1" 204 0
2026-03-30 09:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 541f9e52-6c53-54b7-bbad-4822c03ff5ab with identifier: PZ28359
2026-03-30 09:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 541f9e52-6c53-54b7-bbad-4822c03ff5ab with identifier: PZ28359
2026-03-30 09:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 541f9e52-6c53-54b7-bbad-4822c03ff5ab with identifier: PZ28359 to the API
2026-03-30 09:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:05:50Z',
 'fuel_type': 'petrol',
 'id': '541f9e52-6c53-54b7-bbad-4822c03ff5ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ28359',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 132259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-03',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2013}
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ28359%27 HTTP/1.1" 200 None
2026-03-30 09:01:11 [auto1.it] INFO: Saving data for PZ28359: {'auction_closing_time': 1774969550.0, 'created_time': 1773921644.328993, 'last_price_update_time': 1774861271.105612}
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ28359') HTTP/1.1" 204 0
2026-03-30 09:01:11 [auto1.it] INFO: Found listing with ID: YH99570
2026-03-30 09:01:11 [auto1.it] INFO: Found listing with ID: UF18413
2026-03-30 09:01:11 [auto1.it] INFO: Found listing with ID: EY30987
2026-03-30 09:01:11 [auto1.it] INFO: Found listing with ID: WF75031
2026-03-30 09:01:11 [auto1.it] INFO: Found listing with ID: ST73163
2026-03-30 09:01:11 [auto1.it] INFO: Found listing with ID: AP34592
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP34592%27 HTTP/1.1" 200 None
2026-03-30 09:01:11 [auto1.it] INFO: Scrape type for AP34592: 1
2026-03-30 09:01:11 [auto1.it] INFO: Found listing with ID: VA85498
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA85498%27 HTTP/1.1" 200 None
2026-03-30 09:01:11 [auto1.it] INFO: Scrape type for VA85498: 1
2026-03-30 09:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dcecd0>
2026-03-30 09:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_eeb9adebb7f53d8615b218a7f08f485d.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_eeb9adebb7f53d8615b218a7f08f485d.jpg saved to cache
2026-03-30 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb2ef62d-81fd-55da-a334-042e161f797a
2026-03-30 09:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e812d0>
2026-03-30 09:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0111fab5-206d-5b8b-b400-49b41be7ccfc/0111fab5-206d-5b8b-b400-49b41be7ccfc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fc9%252Ff1c960b581479c9cf55375564600d2d9%252Fpa%252FAD37859_3b97c14238b34dfca5c13f8f67b5d16e.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_3b97c14238b34dfca5c13f8f67b5d16e.jpg saved to cache
2026-03-30 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0111fab5-206d-5b8b-b400-49b41be7ccfc
2026-03-30 09:01:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0111fab5-206d-5b8b-b400-49b41be7ccfc, skipping ID generation
2026-03-30 09:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0111fab5-206d-5b8b-b400-49b41be7ccfc with scrape type 1
2026-03-30 09:01:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0111fab5-206d-5b8b-b400-49b41be7ccfc sending to next pipeline
2026-03-30 09:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0111fab5-206d-5b8b-b400-49b41be7ccfc, identifier: AD37859
2026-03-30 09:01:11 [auto1.it] INFO: Found listing with ID: SC36989
2026-03-30 09:01:11 [auto1.it] INFO: Found listing with ID: SB02789
2026-03-30 09:01:11 [auto1.it] INFO: Found listing with ID: JY89791
2026-03-30 09:01:11 [auto1.it] INFO: Found listing with ID: JW12338
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW12338%27 HTTP/1.1" 200 None
2026-03-30 09:01:11 [auto1.it] INFO: Scrape type for JW12338: 1
2026-03-30 09:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV71970> (referer: https://www.auto1.com/v1/car-details-view/GV71970/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH19388> (referer: https://www.auto1.com/v1/car-details-view/ZH19388/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0111fab5-206d-5b8b-b400-49b41be7ccfc with identifier: AD37859
2026-03-30 09:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0111fab5-206d-5b8b-b400-49b41be7ccfc with identifier: AD37859
2026-03-30 09:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0111fab5-206d-5b8b-b400-49b41be7ccfc with identifier: AD37859 to the API
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_3b97c14238b34dfca5c13f8f67b5d16e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:59:03Z',
 'fuel_type': 'petrol',
 'id': '0111fab5-206d-5b8b-b400-49b41be7ccfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD37859',
 'listing': 'auction',
 'location': 'IT, Arezzo',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 183839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0111fab5-206d-5b8b-b400-49b41be7ccfc/0111fab5-206d-5b8b-b400-49b41be7ccfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_3b97c14238b34dfca5c13f8f67b5d16e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0111fab5-206d-5b8b-b400-49b41be7ccfc/0111fab5-206d-5b8b-b400-49b41be7ccfc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_040bd3f641bd095f260157ed1bfbf2f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0111fab5-206d-5b8b-b400-49b41be7ccfc/0111fab5-206d-5b8b-b400-49b41be7ccfc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_8b968e533c29467b8398a457ed4a0d2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0111fab5-206d-5b8b-b400-49b41be7ccfc/0111fab5-206d-5b8b-b400-49b41be7ccfc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_32aa452798c564c59149a7d122da6799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0111fab5-206d-5b8b-b400-49b41be7ccfc/0111fab5-206d-5b8b-b400-49b41be7ccfc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/c9/f1c960b581479c9cf55375564600d2d9/pa/AD37859_7c03259bf677d848e1fe9c8c6d3b5068.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD37859%27 HTTP/1.1" 200 None
2026-03-30 09:01:11 [auto1.it] INFO: Saving data for AD37859: {'created_time': 1774861271.946238, 'last_price_update_time': 1774861271.946261, 'auction_closing_time': 1774972743.0}
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AD37859') HTTP/1.1" 204 0
2026-03-30 09:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_6650df2dc45495ae9851665b4b3d3503.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:12 [auto1.it] INFO: Found listing with ID: CW61411
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW61411%27 HTTP/1.1" 200 None
2026-03-30 09:01:12 [auto1.it] INFO: Scrape type for CW61411: 2
2026-03-30 09:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 334f8622-14a4-576f-9bcb-2cf3436d7cfb with identifier: CW61411
2026-03-30 09:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 334f8622-14a4-576f-9bcb-2cf3436d7cfb with scrape type 2
2026-03-30 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 334f8622-14a4-576f-9bcb-2cf3436d7cfb with scrape type 2
2026-03-30 09:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 334f8622-14a4-576f-9bcb-2cf3436d7cfb, identifier: CW61411
2026-03-30 09:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY72702> (referer: https://www.auto1.com/v1/car-details-view/WY72702/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 334f8622-14a4-576f-9bcb-2cf3436d7cfb with identifier: CW61411
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 09:01:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 334f8622-14a4-576f-9bcb-2cf3436d7cfb with identifier: CW61411
2026-03-30 09:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 334f8622-14a4-576f-9bcb-2cf3436d7cfb with identifier: CW61411 to the API
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 114,
 'expiration_date': '2026-03-31T15:53:56Z',
 'fuel_type': 'gas',
 'id': '334f8622-14a4-576f-9bcb-2cf3436d7cfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW61411',
 'listing': 'auction',
 'make': 'DR',
 'model': 'DR 3.0',
 'odometer': 19757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-30',
 'seller_name': None,
 'title': 'DR DR 3.0 1.5 LPG',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW61411%27 HTTP/1.1" 200 None
2026-03-30 09:01:12 [auto1.it] INFO: Saving data for CW61411: {'auction_closing_time': 1774972436.0, 'created_time': 1774267336.078925, 'last_price_update_time': 1774861272.753949}
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CW61411') HTTP/1.1" 204 0
2026-03-30 09:01:12 [auto1.it] INFO: Found listing with ID: NM25004
2026-03-30 09:01:12 [auto1.it] INFO: Found listing with ID: KE87600
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE87600%27 HTTP/1.1" 200 None
2026-03-30 09:01:12 [auto1.it] INFO: Scrape type for KE87600: 1
2026-03-30 09:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ef9710>
2026-03-30 09:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6774c04b-8b8a-5da1-ab3d-291bf0391fe1/6774c04b-8b8a-5da1-ab3d-291bf0391fe1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F92%252F5f920d05e0ee3bd323e438b87c6ed6e1%252Fpa%252FDP93203_938e5087508a21e19741e9aba08b3a52.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_938e5087508a21e19741e9aba08b3a52.jpg saved to cache
2026-03-30 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6774c04b-8b8a-5da1-ab3d-291bf0391fe1
2026-03-30 09:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06390810>
2026-03-30 09:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59cfabbb-5ae0-5a2d-a230-cac57f32ebb9/59cfabbb-5ae0-5a2d-a230-cac57f32ebb9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F32%252F793261912116f19bcabfea47eed89349%252Fpa%252FTX80167_38e6c22bae04048d5f70e729a6fee164.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_38e6c22bae04048d5f70e729a6fee164.jpg saved to cache
2026-03-30 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9
2026-03-30 09:01:12 [auto1.it] INFO: Found listing with ID: VN45721
2026-03-30 09:01:12 [auto1.it] INFO: Found listing with ID: FJ15819
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ15819%27 HTTP/1.1" 200 None
2026-03-30 09:01:12 [auto1.it] INFO: Scrape type for FJ15819: 1
2026-03-30 09:01:12 [auto1.it] INFO: Found listing with ID: GK84881
2026-03-30 09:01:12 [auto1.it] INFO: Found listing with ID: UT34552
2026-03-30 09:01:12 [auto1.it] INFO: Found listing with ID: RJ74890
2026-03-30 09:01:12 [auto1.it] INFO: Found listing with ID: DK43597
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK43597%27 HTTP/1.1" 200 None
2026-03-30 09:01:12 [auto1.it] INFO: Scrape type for DK43597: 1
2026-03-30 09:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8fe3c62-8193-5792-81f3-d786995a17cf with identifier: GV71970
2026-03-30 09:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8fe3c62-8193-5792-81f3-d786995a17cf with scrape type 1
2026-03-30 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8fe3c62-8193-5792-81f3-d786995a17cf
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_326f9dee8768a649eecd38715ba6d4e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_326f9dee8768a649eecd38715ba6d4e7.jpg not downloaded yet
2026-03-30 09:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88d77b50-9bcf-5f02-85c3-59ee5e61c74b with identifier: ZH19388
2026-03-30 09:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b with scrape type 1
2026-03-30 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_99167cf3aed27f026c4d847bc2640016.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_99167cf3aed27f026c4d847bc2640016.jpg not downloaded yet
2026-03-30 09:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06379d90>
2026-03-30 09:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F35%252F453586c8609eed9183b19f5b7fb5773d%252Fpa%252FTP54883_6650df2dc45495ae9851665b4b3d3503.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_6650df2dc45495ae9851665b4b3d3503.jpg saved to cache
2026-03-30 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb2ef62d-81fd-55da-a334-042e161f797a
2026-03-30 09:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb2ef62d-81fd-55da-a334-042e161f797a, skipping ID generation
2026-03-30 09:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb2ef62d-81fd-55da-a334-042e161f797a with scrape type 1
2026-03-30 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb2ef62d-81fd-55da-a334-042e161f797a sending to next pipeline
2026-03-30 09:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eb2ef62d-81fd-55da-a334-042e161f797a, identifier: TP54883
2026-03-30 09:01:13 [auto1.it] INFO: Found listing with ID: RX35107
2026-03-30 09:01:13 [auto1.it] INFO: Found listing with ID: LH23516
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH23516%27 HTTP/1.1" 200 None
2026-03-30 09:01:13 [auto1.it] INFO: Scrape type for LH23516: 1
2026-03-30 09:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eb2ef62d-81fd-55da-a334-042e161f797a with identifier: TP54883
2026-03-30 09:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eb2ef62d-81fd-55da-a334-042e161f797a with identifier: TP54883
2026-03-30 09:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eb2ef62d-81fd-55da-a334-042e161f797a with identifier: TP54883 to the API
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_6650df2dc45495ae9851665b4b3d3503.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:03:46Z',
 'fuel_type': 'diesel',
 'id': 'eb2ef62d-81fd-55da-a334-042e161f797a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP54883',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 107337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1402349,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_7f9b1aed153c1cb90649bb30b3076c4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1402349,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_6e3a80e1d9382182d963267597141cc7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3678361,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_6650df2dc45495ae9851665b4b3d3503.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3564534,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_eeb9adebb7f53d8615b218a7f08f485d.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4295078,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_ed2c359b8c9c35f44dc96789692e9191.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1245352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_e6b884bb4bd6566bdbf0ae9221ff4e75.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1258996,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_686a4bc58579d731087a3cd047adc897.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3361245,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_82239a63ef329484dc61762e49fdfbcc.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2882903,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_08bfd94c12ba1570c608f034603baabe.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ef62d-81fd-55da-a334-042e161f797a/eb2ef62d-81fd-55da-a334-042e161f797a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3628562,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img45/35/453586c8609eed9183b19f5b7fb5773d/pa/TP54883_041b66d55e4b4fd16cf5f848c4c5b1be.jpg',
             'Width': 4032}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.5 CDTI INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2020}
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP54883%27 HTTP/1.1" 200 None
2026-03-30 09:01:13 [auto1.it] INFO: Saving data for TP54883: {'created_time': 1774861273.772487, 'last_price_update_time': 1774861273.772499, 'auction_closing_time': 1774969426.0}
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TP54883') HTTP/1.1" 204 0
2026-03-30 09:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3aa0ca40-c085-5e00-af7b-13748b95d30e with identifier: WY72702
2026-03-30 09:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3aa0ca40-c085-5e00-af7b-13748b95d30e with scrape type 1
2026-03-30 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3aa0ca40-c085-5e00-af7b-13748b95d30e
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_4571eddf4802a96ba5d4493c87d9632f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_4571eddf4802a96ba5d4493c87d9632f.jpg not downloaded yet
2026-03-30 09:01:13 [auto1.it] INFO: Found listing with ID: HY55769
2026-03-30 09:01:13 [auto1.it] INFO: Found listing with ID: LJ03272
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ03272%27 HTTP/1.1" 200 None
2026-03-30 09:01:13 [auto1.it] INFO: Scrape type for LJ03272: 1
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_55ae13fb268f40b3744e82b3751dd4a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_55ae13fb268f40b3744e82b3751dd4a3.jpg not downloaded yet
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_1efa4ee5011c0686158033e44b1cc722.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_1efa4ee5011c0686158033e44b1cc722.jpg not downloaded yet
2026-03-30 09:01:13 [auto1.it] INFO: Found listing with ID: GZ60590
2026-03-30 09:01:13 [auto1.it] INFO: Found listing with ID: FD90362
2026-03-30 09:01:13 [auto1.it] INFO: Found listing with ID: YA01979
2026-03-30 09:01:13 [auto1.it] INFO: Found listing with ID: EP59254
2026-03-30 09:01:13 [auto1.it] INFO: Found listing with ID: NR09565
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR09565%27 HTTP/1.1" 200 None
2026-03-30 09:01:13 [auto1.it] INFO: Scrape type for NR09565: 2
2026-03-30 09:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7942de23-c69a-561a-a9da-503cf5ae8db6 with identifier: NR09565
2026-03-30 09:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7942de23-c69a-561a-a9da-503cf5ae8db6 with scrape type 2
2026-03-30 09:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7942de23-c69a-561a-a9da-503cf5ae8db6 with scrape type 2
2026-03-30 09:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7942de23-c69a-561a-a9da-503cf5ae8db6, identifier: NR09565
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_6d0aa6ccd5b9214628ced7ecd907c2f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_6d0aa6ccd5b9214628ced7ecd907c2f7.jpg not downloaded yet
2026-03-30 09:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7942de23-c69a-561a-a9da-503cf5ae8db6 with identifier: NR09565
2026-03-30 09:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7942de23-c69a-561a-a9da-503cf5ae8db6 with identifier: NR09565
2026-03-30 09:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7942de23-c69a-561a-a9da-503cf5ae8db6 with identifier: NR09565 to the API
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:26:35Z',
 'fuel_type': 'diesel',
 'id': '7942de23-c69a-561a-a9da-503cf5ae8db6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR09565',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 78148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2022}
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR09565%27 HTTP/1.1" 200 None
2026-03-30 09:01:14 [auto1.it] INFO: Saving data for NR09565: {'auction_closing_time': 1774970795.0, 'created_time': 1773824498.29204, 'last_price_update_time': 1774861274.485885}
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR09565') HTTP/1.1" 204 0
2026-03-30 09:01:14 [auto1.it] INFO: Found listing with ID: BW98785
2026-03-30 09:01:14 [auto1.it] INFO: Found listing with ID: MN95731
2026-03-30 09:01:14 [auto1.it] INFO: Found listing with ID: BD07482
2026-03-30 09:01:14 [auto1.it] INFO: Found listing with ID: FK09468
2026-03-30 09:01:14 [auto1.it] INFO: Found listing with ID: WR41361
2026-03-30 09:01:14 [auto1.it] INFO: Found listing with ID: RP34917
2026-03-30 09:01:14 [auto1.it] INFO: Found listing with ID: BX26430
2026-03-30 09:01:14 [auto1.it] INFO: Found listing with ID: VB85022
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB85022%27 HTTP/1.1" 200 None
2026-03-30 09:01:14 [auto1.it] INFO: Scrape type for VB85022: 2
2026-03-30 09:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a7186c3-b60d-58a1-9c35-a6e36ad91ce9 with identifier: VB85022
2026-03-30 09:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a7186c3-b60d-58a1-9c35-a6e36ad91ce9 with scrape type 2
2026-03-30 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a7186c3-b60d-58a1-9c35-a6e36ad91ce9 with scrape type 2
2026-03-30 09:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5a7186c3-b60d-58a1-9c35-a6e36ad91ce9, identifier: VB85022
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_1c8df4ee5e6e8b8a56c93df14363743d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_1c8df4ee5e6e8b8a56c93df14363743d.jpg not downloaded yet
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_212057072b0dc99954759f5491359aa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_212057072b0dc99954759f5491359aa9.jpg not downloaded yet
2026-03-30 09:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB63640/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL21440/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:14 [auto1.it] INFO: Found listing with ID: HT52131
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT52131%27 HTTP/1.1" 200 None
2026-03-30 09:01:14 [auto1.it] INFO: Scrape type for HT52131: 1
2026-03-30 09:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5a7186c3-b60d-58a1-9c35-a6e36ad91ce9 with identifier: VB85022
2026-03-30 09:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5a7186c3-b60d-58a1-9c35-a6e36ad91ce9 with identifier: VB85022
2026-03-30 09:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5a7186c3-b60d-58a1-9c35-a6e36ad91ce9 with identifier: VB85022 to the API
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:46:43Z',
 'fuel_type': 'petrol',
 'id': '5a7186c3-b60d-58a1-9c35-a6e36ad91ce9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB85022',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 126736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-26',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB85022%27 HTTP/1.1" 200 None
2026-03-30 09:01:15 [auto1.it] INFO: Saving data for VB85022: {'auction_closing_time': 1774972003.0, 'created_time': 1774353866.592732, 'last_price_update_time': 1774861275.053175}
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VB85022') HTTP/1.1" 204 0
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_c82416594cc63e7c92f663223c544941.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_c82416594cc63e7c92f663223c544941.jpg not downloaded yet
2026-03-30 09:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:15 [auto1.it] INFO: Found listing with ID: SP78174
2026-03-30 09:01:15 [auto1.it] INFO: Found listing with ID: KY18822
2026-03-30 09:01:15 [auto1.it] INFO: Found listing with ID: RL10918
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL10918%27 HTTP/1.1" 200 None
2026-03-30 09:01:15 [auto1.it] INFO: Scrape type for RL10918: 2
2026-03-30 09:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eb67e60-8906-5599-81f6-65feea8d8b06 with identifier: RL10918
2026-03-30 09:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eb67e60-8906-5599-81f6-65feea8d8b06 with scrape type 2
2026-03-30 09:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eb67e60-8906-5599-81f6-65feea8d8b06 with scrape type 2
2026-03-30 09:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4eb67e60-8906-5599-81f6-65feea8d8b06, identifier: RL10918
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_dfdfb3fd4738889b5052eb15cd677dd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_dfdfb3fd4738889b5052eb15cd677dd9.jpg not downloaded yet
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_eff7e7e72c48df04bb82a17b7fdfcecc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_eff7e7e72c48df04bb82a17b7fdfcecc.jpg not downloaded yet
2026-03-30 09:01:15 [auto1.it] INFO: Found listing with ID: VU13250
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU13250%27 HTTP/1.1" 200 None
2026-03-30 09:01:15 [auto1.it] INFO: Scrape type for VU13250: 1
2026-03-30 09:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4eb67e60-8906-5599-81f6-65feea8d8b06 with identifier: RL10918
2026-03-30 09:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4eb67e60-8906-5599-81f6-65feea8d8b06 with identifier: RL10918
2026-03-30 09:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4eb67e60-8906-5599-81f6-65feea8d8b06 with identifier: RL10918 to the API
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:18:08Z',
 'fuel_type': 'diesel',
 'id': '4eb67e60-8906-5599-81f6-65feea8d8b06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL10918',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 231565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-31',
 'seller_name': None,
 'title': 'Toyota Avensis 2.2 D-4D Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2009}
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL10918%27 HTTP/1.1" 200 None
2026-03-30 09:01:15 [auto1.it] INFO: Saving data for RL10918: {'auction_closing_time': 1774970288.0, 'created_time': 1774353771.817089, 'last_price_update_time': 1774861275.752678}
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RL10918') HTTP/1.1" 204 0
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_a7e85451ef41d9db788b677742bd9855.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_a7e85451ef41d9db788b677742bd9855.jpg not downloaded yet
2026-03-30 09:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM45638/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:15 [auto1.it] INFO: Found listing with ID: WL49427
2026-03-30 09:01:15 [auto1.it] INFO: Found listing with ID: EL74502
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL74502%27 HTTP/1.1" 200 None
2026-03-30 09:01:15 [auto1.it] INFO: Scrape type for EL74502: 2
2026-03-30 09:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2584430-2761-5209-89bf-66abf2de256d with identifier: EL74502
2026-03-30 09:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2584430-2761-5209-89bf-66abf2de256d with scrape type 2
2026-03-30 09:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2584430-2761-5209-89bf-66abf2de256d with scrape type 2
2026-03-30 09:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f2584430-2761-5209-89bf-66abf2de256d, identifier: EL74502
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_a39c65ec93d42774f308253dae02f11e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_a39c65ec93d42774f308253dae02f11e.jpg not downloaded yet
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_bde3522ddb284bf85fcc11010e19bb2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_bde3522ddb284bf85fcc11010e19bb2b.jpg not downloaded yet
2026-03-30 09:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_6d0aa6ccd5b9214628ced7ecd907c2f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:15 [auto1.it] INFO: Found listing with ID: CM15211
2026-03-30 09:01:15 [auto1.it] INFO: Found listing with ID: ZM54486
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM54486%27 HTTP/1.1" 200 None
2026-03-30 09:01:15 [auto1.it] INFO: Scrape type for ZM54486: 1
2026-03-30 09:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f2584430-2761-5209-89bf-66abf2de256d with identifier: EL74502
2026-03-30 09:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f2584430-2761-5209-89bf-66abf2de256d with identifier: EL74502
2026-03-30 09:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f2584430-2761-5209-89bf-66abf2de256d with identifier: EL74502 to the API
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:56:04Z',
 'fuel_type': 'diesel',
 'id': 'f2584430-2761-5209-89bf-66abf2de256d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL74502',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 137179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-20',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2014}
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL74502%27 HTTP/1.1" 200 None
2026-03-30 09:01:16 [auto1.it] INFO: Saving data for EL74502: {'auction_closing_time': 1774972564.0, 'created_time': 1774440208.893262, 'last_price_update_time': 1774861276.377672}
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EL74502') HTTP/1.1" 204 0
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_c01ebb94cc525016ac45b5c97a36e24d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_c01ebb94cc525016ac45b5c97a36e24d.jpg not downloaded yet
2026-03-30 09:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ37544/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:16 [auto1.it] INFO: Found listing with ID: MY36901
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY36901%27 HTTP/1.1" 200 None
2026-03-30 09:01:16 [auto1.it] INFO: Scrape type for MY36901: 2
2026-03-30 09:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd339067-1c3a-57bc-afc2-dbf9a32096d6 with identifier: MY36901
2026-03-30 09:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd339067-1c3a-57bc-afc2-dbf9a32096d6 with scrape type 2
2026-03-30 09:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd339067-1c3a-57bc-afc2-dbf9a32096d6 with scrape type 2
2026-03-30 09:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bd339067-1c3a-57bc-afc2-dbf9a32096d6, identifier: MY36901
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_623347e62676787c752f7b01a41f4f7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_623347e62676787c752f7b01a41f4f7b.jpg not downloaded yet
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_52b7b6e9c86f371f9cb8ccdf16c726e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_52b7b6e9c86f371f9cb8ccdf16c726e4.jpg not downloaded yet
2026-03-30 09:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP37847/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:16 [auto1.it] INFO: Found listing with ID: SV41912
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV41912%27 HTTP/1.1" 200 None
2026-03-30 09:01:16 [auto1.it] INFO: Scrape type for SV41912: 1
2026-03-30 09:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bd339067-1c3a-57bc-afc2-dbf9a32096d6 with identifier: MY36901
2026-03-30 09:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bd339067-1c3a-57bc-afc2-dbf9a32096d6 with identifier: MY36901
2026-03-30 09:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bd339067-1c3a-57bc-afc2-dbf9a32096d6 with identifier: MY36901 to the API
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:27:38Z',
 'fuel_type': 'petrol',
 'id': 'bd339067-1c3a-57bc-afc2-dbf9a32096d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY36901',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 65790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-22',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY36901%27 HTTP/1.1" 200 None
2026-03-30 09:01:16 [auto1.it] INFO: Saving data for MY36901: {'auction_closing_time': 1774970858.0, 'created_time': 1773910867.302333, 'last_price_update_time': 1774861276.959018}
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MY36901') HTTP/1.1" 204 0
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_aced8fec8dd67c4789c7e05b7ecff3fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_aced8fec8dd67c4789c7e05b7ecff3fb.jpg not downloaded yet
2026-03-30 09:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:17 [auto1.it] INFO: Found listing with ID: FD49777
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD49777%27 HTTP/1.1" 200 None
2026-03-30 09:01:17 [auto1.it] INFO: Scrape type for FD49777: 1
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_abdcfc2efc270531e9bb8e6a4858db33.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_abdcfc2efc270531e9bb8e6a4858db33.jpg not downloaded yet
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_bc6907aa1884cfb235e6b86d0e549e48.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_bc6907aa1884cfb235e6b86d0e549e48.jpg not downloaded yet
2026-03-30 09:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c9c350>
2026-03-30 09:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_6d0aa6ccd5b9214628ced7ecd907c2f7.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_6d0aa6ccd5b9214628ced7ecd907c2f7.jpg saved to cache
2026-03-30 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3aa0ca40-c085-5e00-af7b-13748b95d30e
2026-03-30 09:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_a7e85451ef41d9db788b677742bd9855.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:17 [auto1.it] INFO: Found listing with ID: AV22109
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV22109%27 HTTP/1.1" 200 None
2026-03-30 09:01:17 [auto1.it] INFO: Scrape type for AV22109: 2
2026-03-30 09:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43365835-5396-5c33-aa33-e0e54c84d3f8 with identifier: AV22109
2026-03-30 09:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43365835-5396-5c33-aa33-e0e54c84d3f8 with scrape type 2
2026-03-30 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43365835-5396-5c33-aa33-e0e54c84d3f8 with scrape type 2
2026-03-30 09:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 43365835-5396-5c33-aa33-e0e54c84d3f8, identifier: AV22109
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_f98c98b357936a720d8c06cbc9bd0fe7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_f98c98b357936a720d8c06cbc9bd0fe7.jpg not downloaded yet
2026-03-30 09:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB99358> (referer: https://www.auto1.com/v1/car-details-view/BB99358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 43365835-5396-5c33-aa33-e0e54c84d3f8 with identifier: AV22109
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 09:01:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 43365835-5396-5c33-aa33-e0e54c84d3f8 with identifier: AV22109
2026-03-30 09:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 43365835-5396-5c33-aa33-e0e54c84d3f8 with identifier: AV22109 to the API
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-31T15:33:12Z',
 'fuel_type': 'electro',
 'id': '43365835-5396-5c33-aa33-e0e54c84d3f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV22109',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 66,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-28',
 'seller_name': None,
 'title': 'Peugeot 2008 electric drive 115 kW Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2024}
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV22109%27 HTTP/1.1" 200 None
2026-03-30 09:01:17 [auto1.it] INFO: Saving data for AV22109: {'auction_closing_time': 1774971192.0, 'created_time': 1774040813.732474, 'last_price_update_time': 1774861277.799058}
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AV22109') HTTP/1.1" 204 0
2026-03-30 09:01:17 [auto1.it] INFO: Found listing with ID: FX24983
2026-03-30 09:01:17 [auto1.it] INFO: Found listing with ID: DN10540
2026-03-30 09:01:17 [auto1.it] INFO: Found listing with ID: JZ33949
2026-03-30 09:01:17 [auto1.it] INFO: Found listing with ID: TB83381
2026-03-30 09:01:17 [auto1.it] INFO: Found listing with ID: VM11321
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_401efd59c31819af9c0e63ec538e6993.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_401efd59c31819af9c0e63ec538e6993.jpg not downloaded yet
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_bb1f2f7f7b6d8882fefda38f3154fc2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_bb1f2f7f7b6d8882fefda38f3154fc2d.jpg not downloaded yet
2026-03-30 09:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ25588/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:17 [auto1.it] INFO: Found listing with ID: JA46971
2026-03-30 09:01:17 [auto1.it] INFO: Found listing with ID: CK19595
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK19595%27 HTTP/1.1" 200 None
2026-03-30 09:01:17 [auto1.it] INFO: Scrape type for CK19595: 1
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_7273adac52d7337df5ff91a1e0daa93d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_7273adac52d7337df5ff91a1e0daa93d.jpg not downloaded yet
2026-03-30 09:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_e6745a9674c346ebaea435c2361a9b92.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_e6745a9674c346ebaea435c2361a9b92.jpg not downloaded yet
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_0bba5000217435d99236a965f6be0b50.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_0bba5000217435d99236a965f6be0b50.jpg not downloaded yet
2026-03-30 09:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ded310>
2026-03-30 09:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_a7e85451ef41d9db788b677742bd9855.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_a7e85451ef41d9db788b677742bd9855.jpg saved to cache
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3aa0ca40-c085-5e00-af7b-13748b95d30e
2026-03-30 09:01:18 [auto1.it] INFO: Found listing with ID: KY08376
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY08376%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [auto1.it] INFO: Scrape type for KY08376: 2
2026-03-30 09:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd8168d-9efb-50f0-91c6-060b00cf909a with identifier: KY08376
2026-03-30 09:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd8168d-9efb-50f0-91c6-060b00cf909a with scrape type 2
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fd8168d-9efb-50f0-91c6-060b00cf909a with scrape type 2
2026-03-30 09:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7fd8168d-9efb-50f0-91c6-060b00cf909a, identifier: KY08376
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_b78a84f261e3a3d30ce7f92660217606.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_b78a84f261e3a3d30ce7f92660217606.jpg not downloaded yet
2026-03-30 09:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL10517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP53767/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e296273-e517-5703-b8a2-e0c9b9610853 with identifier: BB99358
2026-03-30 09:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e296273-e517-5703-b8a2-e0c9b9610853 with scrape type 1
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e296273-e517-5703-b8a2-e0c9b9610853
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F94%252Ffb945c4ed33606177e407f6e49edfe03%252Fpa%252FBB99358_8fc0dcab0809c54547516866fc9ee604.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_8fc0dcab0809c54547516866fc9ee604.jpg already downloaded
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F94%252Ffb945c4ed33606177e407f6e49edfe03%252Fpa%252FBB99358_873ae65a16b030e278645cd2b60cf6a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_873ae65a16b030e278645cd2b60cf6a4.jpg already downloaded
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F94%252Ffb945c4ed33606177e407f6e49edfe03%252Fpa%252FBB99358_475c8a5c1b7f36e09bda0c3a1dd5cd05.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_475c8a5c1b7f36e09bda0c3a1dd5cd05.jpg already downloaded
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F94%252Ffb945c4ed33606177e407f6e49edfe03%252Fpa%252FBB99358_442e1f860eb47b87efc51f42fbbf5777.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_442e1f860eb47b87efc51f42fbbf5777.jpg already downloaded
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F94%252Ffb945c4ed33606177e407f6e49edfe03%252Fpa%252FBB99358_af293b88a804f923191df577a0a12fe1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_af293b88a804f923191df577a0a12fe1.jpg already downloaded
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F94%252Ffb945c4ed33606177e407f6e49edfe03%252Fpa%252FBB99358_4db991c41d8b5ce2cc2b83effdf7d184.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_4db991c41d8b5ce2cc2b83effdf7d184.jpg already downloaded
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F94%252Ffb945c4ed33606177e407f6e49edfe03%252Fpa%252FBB99358_472ca65add9396e8a29f00619ed458f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_472ca65add9396e8a29f00619ed458f1.jpg already downloaded
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F94%252Ffb945c4ed33606177e407f6e49edfe03%252Fpa%252FBB99358_37007a3df1378ed97914262bc06cbb88.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_37007a3df1378ed97914262bc06cbb88.jpg already downloaded
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F94%252Ffb945c4ed33606177e407f6e49edfe03%252Fpa%252FBB99358_e05548a210a446106accf85604dfa1b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_e05548a210a446106accf85604dfa1b0.jpg already downloaded
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F94%252Ffb945c4ed33606177e407f6e49edfe03%252Fpa%252FBB99358_d6c745c478a58192177da4fb344fa2cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_d6c745c478a58192177da4fb344fa2cb.jpg already downloaded
2026-03-30 09:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e296273-e517-5703-b8a2-e0c9b9610853, identifier: BB99358
2026-03-30 09:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_aced8fec8dd67c4789c7e05b7ecff3fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7fd8168d-9efb-50f0-91c6-060b00cf909a with identifier: KY08376
2026-03-30 09:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7fd8168d-9efb-50f0-91c6-060b00cf909a with identifier: KY08376
2026-03-30 09:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7fd8168d-9efb-50f0-91c6-060b00cf909a with identifier: KY08376 to the API
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:11:56Z',
 'fuel_type': 'electro',
 'id': '7fd8168d-9efb-50f0-91c6-060b00cf909a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY08376',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 5,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-29',
 'seller_name': None,
 'title': 'Fiat Scudo electric drive 100 kW L2',
 'transmission': 'automatic',
 'trim': 'L2',
 'year': 2025}
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY08376%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [auto1.it] INFO: Saving data for KY08376: {'auction_closing_time': 1774969916.0, 'created_time': 1774040745.577305, 'last_price_update_time': 1774861278.914581}
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KY08376') HTTP/1.1" 204 0
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_f9cf1de9bb18ff4f006751522a0c0f90.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_f9cf1de9bb18ff4f006751522a0c0f90.jpg not downloaded yet
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_66c81dda243d5759fc56a61e42a4cf58.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_66c81dda243d5759fc56a61e42a4cf58.jpg not downloaded yet
2026-03-30 09:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e296273-e517-5703-b8a2-e0c9b9610853 with identifier: BB99358
2026-03-30 09:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e296273-e517-5703-b8a2-e0c9b9610853 with identifier: BB99358
2026-03-30 09:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e296273-e517-5703-b8a2-e0c9b9610853 with identifier: BB99358 to the API
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BB99358>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:48:10Z',
 'fuel_type': 'diesel',
 'id': '4e296273-e517-5703-b8a2-e0c9b9610853',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB99358',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 142691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_8fc0dcab0809c54547516866fc9ee604.jpg',
                'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_873ae65a16b030e278645cd2b60cf6a4.jpg',
                'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_475c8a5c1b7f36e09bda0c3a1dd5cd05.jpg',
                'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_442e1f860eb47b87efc51f42fbbf5777.jpg',
                'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_af293b88a804f923191df577a0a12fe1.jpg',
                'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_4db991c41d8b5ce2cc2b83effdf7d184.jpg',
                'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_472ca65add9396e8a29f00619ed458f1.jpg',
                'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_37007a3df1378ed97914262bc06cbb88.jpg',
                'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_e05548a210a446106accf85604dfa1b0.jpg',
                'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_d6c745c478a58192177da4fb344fa2cb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e296273-e517-5703-b8a2-e0c9b9610853/4e296273-e517-5703-b8a2-e0c9b9610853_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_8fc0dcab0809c54547516866fc9ee604.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e296273-e517-5703-b8a2-e0c9b9610853/4e296273-e517-5703-b8a2-e0c9b9610853_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_873ae65a16b030e278645cd2b60cf6a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e296273-e517-5703-b8a2-e0c9b9610853/4e296273-e517-5703-b8a2-e0c9b9610853_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_475c8a5c1b7f36e09bda0c3a1dd5cd05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e296273-e517-5703-b8a2-e0c9b9610853/4e296273-e517-5703-b8a2-e0c9b9610853_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518495,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_442e1f860eb47b87efc51f42fbbf5777.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e296273-e517-5703-b8a2-e0c9b9610853/4e296273-e517-5703-b8a2-e0c9b9610853_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2516428,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_af293b88a804f923191df577a0a12fe1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e296273-e517-5703-b8a2-e0c9b9610853/4e296273-e517-5703-b8a2-e0c9b9610853_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3060769,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_4db991c41d8b5ce2cc2b83effdf7d184.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e296273-e517-5703-b8a2-e0c9b9610853/4e296273-e517-5703-b8a2-e0c9b9610853_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2464860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_472ca65add9396e8a29f00619ed458f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e296273-e517-5703-b8a2-e0c9b9610853/4e296273-e517-5703-b8a2-e0c9b9610853_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2522507,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_37007a3df1378ed97914262bc06cbb88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e296273-e517-5703-b8a2-e0c9b9610853/4e296273-e517-5703-b8a2-e0c9b9610853_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_e05548a210a446106accf85604dfa1b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e296273-e517-5703-b8a2-e0c9b9610853/4e296273-e517-5703-b8a2-e0c9b9610853_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/94/fb945c4ed33606177e407f6e49edfe03/pa/BB99358_d6c745c478a58192177da4fb344fa2cb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB99358%27 HTTP/1.1" 200 None
2026-03-30 09:01:19 [auto1.it] INFO: Saving data for BB99358: {'created_time': 1774861279.3758, 'last_price_update_time': 1774861279.375811, 'auction_closing_time': 1774972090.0}
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BB99358') HTTP/1.1" 204 0
2026-03-30 09:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_f98c98b357936a720d8c06cbc9bd0fe7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:19 [auto1.it] INFO: Found listing with ID: JP33572
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_accf28a5a5b427fa42e31f7ff38fb717.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_accf28a5a5b427fa42e31f7ff38fb717.jpg not downloaded yet
2026-03-30 09:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e654d0>
2026-03-30 09:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_aced8fec8dd67c4789c7e05b7ecff3fb.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_aced8fec8dd67c4789c7e05b7ecff3fb.jpg saved to cache
2026-03-30 09:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3aa0ca40-c085-5e00-af7b-13748b95d30e
2026-03-30 09:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_7273adac52d7337df5ff91a1e0daa93d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_e6745a9674c346ebaea435c2361a9b92.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f59fd0>
2026-03-30 09:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_f98c98b357936a720d8c06cbc9bd0fe7.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_f98c98b357936a720d8c06cbc9bd0fe7.jpg saved to cache
2026-03-30 09:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3aa0ca40-c085-5e00-af7b-13748b95d30e
2026-03-30 09:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_b78a84f261e3a3d30ce7f92660217606.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:19 [auto1.it] INFO: Channel: 24h | Page: 6 | totalHits: 3285 | hits on page: 40
2026-03-30 09:01:19 [auto1.it] INFO: Found listing with ID: VM11321
2026-03-30 09:01:19 [auto1.it] INFO: Found listing with ID: KL91026
2026-03-30 09:01:19 [auto1.it] INFO: Found listing with ID: GD21470
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD21470%27 HTTP/1.1" 200 None
2026-03-30 09:01:19 [auto1.it] INFO: Scrape type for GD21470: 2
2026-03-30 09:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5993fd2f-abac-5109-ae20-67cdde39d85a with identifier: GD21470
2026-03-30 09:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5993fd2f-abac-5109-ae20-67cdde39d85a with scrape type 2
2026-03-30 09:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5993fd2f-abac-5109-ae20-67cdde39d85a with scrape type 2
2026-03-30 09:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5993fd2f-abac-5109-ae20-67cdde39d85a, identifier: GD21470
2026-03-30 09:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5993fd2f-abac-5109-ae20-67cdde39d85a with identifier: GD21470
2026-03-30 09:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5993fd2f-abac-5109-ae20-67cdde39d85a with identifier: GD21470
2026-03-30 09:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5993fd2f-abac-5109-ae20-67cdde39d85a with identifier: GD21470 to the API
2026-03-30 09:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:47:05Z',
 'fuel_type': 'diesel',
 'id': '5993fd2f-abac-5109-ae20-67cdde39d85a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD21470',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 52356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-04',
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2022}
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD21470%27 HTTP/1.1" 200 None
2026-03-30 09:01:20 [auto1.it] INFO: Saving data for GD21470: {'auction_closing_time': 1774972025.0, 'created_time': 1774386117.431883, 'last_price_update_time': 1774861280.272288}
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GD21470') HTTP/1.1" 204 0
2026-03-30 09:01:20 [auto1.it] INFO: Found listing with ID: LX69151
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX69151%27 HTTP/1.1" 200 None
2026-03-30 09:01:20 [auto1.it] INFO: Scrape type for LX69151: 2
2026-03-30 09:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cd0075b-1604-5e88-b6d6-250d122c33c1 with identifier: LX69151
2026-03-30 09:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cd0075b-1604-5e88-b6d6-250d122c33c1 with scrape type 2
2026-03-30 09:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cd0075b-1604-5e88-b6d6-250d122c33c1 with scrape type 2
2026-03-30 09:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1cd0075b-1604-5e88-b6d6-250d122c33c1, identifier: LX69151
2026-03-30 09:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_accf28a5a5b427fa42e31f7ff38fb717.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1cd0075b-1604-5e88-b6d6-250d122c33c1 with identifier: LX69151
2026-03-30 09:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1cd0075b-1604-5e88-b6d6-250d122c33c1 with identifier: LX69151
2026-03-30 09:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1cd0075b-1604-5e88-b6d6-250d122c33c1 with identifier: LX69151 to the API
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:03:24Z',
 'fuel_type': 'diesel',
 'id': '1cd0075b-1604-5e88-b6d6-250d122c33c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX69151',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 217565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-16',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Td4 Prestige',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2012}
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX69151%27 HTTP/1.1" 200 None
2026-03-30 09:01:20 [auto1.it] INFO: Saving data for LX69151: {'auction_closing_time': 1774969404.0, 'created_time': 1774386456.170205, 'last_price_update_time': 1774861280.908835}
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX69151') HTTP/1.1" 204 0
2026-03-30 09:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AP34592/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:20 [auto1.it] INFO: Found listing with ID: SW80726
2026-03-30 09:01:20 [auto1.it] INFO: Found listing with ID: ZL23627
2026-03-30 09:01:20 [auto1.it] INFO: Found listing with ID: YA27479
2026-03-30 09:01:20 [auto1.it] INFO: Found listing with ID: RA21109
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA21109%27 HTTP/1.1" 200 None
2026-03-30 09:01:20 [auto1.it] INFO: Scrape type for RA21109: 2
2026-03-30 09:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 582a7c52-67fa-5189-9e88-ebe1427da23c with identifier: RA21109
2026-03-30 09:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 582a7c52-67fa-5189-9e88-ebe1427da23c with scrape type 2
2026-03-30 09:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 582a7c52-67fa-5189-9e88-ebe1427da23c with scrape type 2
2026-03-30 09:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 582a7c52-67fa-5189-9e88-ebe1427da23c, identifier: RA21109
2026-03-30 09:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW12338/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF41480> (referer: https://www.auto1.com/v1/car-details-view/CF41480/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0625f7d0>
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_7273adac52d7337df5ff91a1e0daa93d.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_7273adac52d7337df5ff91a1e0daa93d.jpg saved to cache
2026-03-30 09:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3aa0ca40-c085-5e00-af7b-13748b95d30e
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e92e90>
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_e6745a9674c346ebaea435c2361a9b92.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_e6745a9674c346ebaea435c2361a9b92.jpg saved to cache
2026-03-30 09:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8fe3c62-8193-5792-81f3-d786995a17cf
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ff4490>
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_b78a84f261e3a3d30ce7f92660217606.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_b78a84f261e3a3d30ce7f92660217606.jpg saved to cache
2026-03-30 09:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3aa0ca40-c085-5e00-af7b-13748b95d30e
2026-03-30 09:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 582a7c52-67fa-5189-9e88-ebe1427da23c with identifier: RA21109
2026-03-30 09:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 582a7c52-67fa-5189-9e88-ebe1427da23c with identifier: RA21109
2026-03-30 09:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 582a7c52-67fa-5189-9e88-ebe1427da23c with identifier: RA21109 to the API
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:19:57Z',
 'fuel_type': 'petrol',
 'id': '582a7c52-67fa-5189-9e88-ebe1427da23c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA21109',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 308272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-03-12',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 4x4',
 'transmission': 'manual',
 'trim': '4x4',
 'year': 2002}
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA21109%27 HTTP/1.1" 200 None
2026-03-30 09:01:21 [auto1.it] INFO: Saving data for RA21109: {'auction_closing_time': 1774970397.0, 'created_time': 1773674117.329958, 'last_price_update_time': 1774861281.545134}
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA21109') HTTP/1.1" 204 0
2026-03-30 09:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB05481> (referer: https://www.auto1.com/v1/car-details-view/NB05481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:21 [auto1.it] INFO: Found listing with ID: NU69507
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU69507%27 HTTP/1.1" 200 None
2026-03-30 09:01:21 [auto1.it] INFO: Scrape type for NU69507: 2
2026-03-30 09:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce6c22be-51fb-57f3-a965-f78a1237f248 with identifier: NU69507
2026-03-30 09:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce6c22be-51fb-57f3-a965-f78a1237f248 with scrape type 2
2026-03-30 09:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce6c22be-51fb-57f3-a965-f78a1237f248 with scrape type 2
2026-03-30 09:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ce6c22be-51fb-57f3-a965-f78a1237f248, identifier: NU69507
2026-03-30 09:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL21440> (referer: https://www.auto1.com/v1/car-details-view/KL21440/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06df0ad0>
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_accf28a5a5b427fa42e31f7ff38fb717.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_accf28a5a5b427fa42e31f7ff38fb717.jpg saved to cache
2026-03-30 09:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3aa0ca40-c085-5e00-af7b-13748b95d30e
2026-03-30 09:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ce6c22be-51fb-57f3-a965-f78a1237f248 with identifier: NU69507
2026-03-30 09:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ce6c22be-51fb-57f3-a965-f78a1237f248 with identifier: NU69507
2026-03-30 09:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ce6c22be-51fb-57f3-a965-f78a1237f248 with identifier: NU69507 to the API
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:11:27Z',
 'fuel_type': 'petrol',
 'id': 'ce6c22be-51fb-57f3-a965-f78a1237f248',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU69507',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 87162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-21',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 White up!',
 'transmission': 'manual',
 'trim': 'White',
 'year': 2012}
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU69507%27 HTTP/1.1" 200 None
2026-03-30 09:01:22 [auto1.it] INFO: Saving data for NU69507: {'auction_closing_time': 1774969887.0, 'created_time': 1774440176.448609, 'last_price_update_time': 1774861282.117612}
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NU69507') HTTP/1.1" 204 0
2026-03-30 09:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79725108-306b-5845-996a-5adf09913893 with identifier: CF41480
2026-03-30 09:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79725108-306b-5845-996a-5adf09913893 with scrape type 1
2026-03-30 09:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 79725108-306b-5845-996a-5adf09913893
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbc%252Fe5bcb94543384972c940e1dc48b5ff99%252Fpa%252FCF41480_6ce3ea07970bb131f84831280eae6a6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_6ce3ea07970bb131f84831280eae6a6b.jpg already downloaded
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbc%252Fe5bcb94543384972c940e1dc48b5ff99%252Fpa%252FCF41480_0504de997e67dcfd4f4355abfa517eb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_0504de997e67dcfd4f4355abfa517eb5.jpg already downloaded
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbc%252Fe5bcb94543384972c940e1dc48b5ff99%252Fpa%252FCF41480_bd4f2f3c60cf6c3d0e65885030abf744.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_bd4f2f3c60cf6c3d0e65885030abf744.jpg already downloaded
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbc%252Fe5bcb94543384972c940e1dc48b5ff99%252Fpa%252FCF41480_5961c9da61db270f7ee56caf0f36917c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_5961c9da61db270f7ee56caf0f36917c.jpg already downloaded
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fbc%252Fe5bcb94543384972c940e1dc48b5ff99%252Fpa%252FCF41480_ec572b06c0ecdec6857f08047755f302.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_ec572b06c0ecdec6857f08047755f302.jpg already downloaded
2026-03-30 09:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 79725108-306b-5845-996a-5adf09913893, identifier: CF41480
2026-03-30 09:01:22 [auto1.it] INFO: Found listing with ID: DE35632
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE35632%27 HTTP/1.1" 200 None
2026-03-30 09:01:22 [auto1.it] INFO: Scrape type for DE35632: 2
2026-03-30 09:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 830757a7-77c7-57b0-a5b6-918edfc4b923 with identifier: DE35632
2026-03-30 09:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 830757a7-77c7-57b0-a5b6-918edfc4b923 with scrape type 2
2026-03-30 09:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 830757a7-77c7-57b0-a5b6-918edfc4b923 with scrape type 2
2026-03-30 09:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 830757a7-77c7-57b0-a5b6-918edfc4b923, identifier: DE35632
2026-03-30 09:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 79725108-306b-5845-996a-5adf09913893 with identifier: CF41480
2026-03-30 09:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 79725108-306b-5845-996a-5adf09913893 with identifier: CF41480
2026-03-30 09:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 79725108-306b-5845-996a-5adf09913893 with identifier: CF41480 to the API
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CF41480>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:37:41Z',
 'fuel_type': 'diesel',
 'id': '79725108-306b-5845-996a-5adf09913893',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF41480',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Alfa Romeo',
 'model': 'Alfa 159',
 'odometer': 194278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_6ce3ea07970bb131f84831280eae6a6b.jpg',
                'https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_0504de997e67dcfd4f4355abfa517eb5.jpg',
                'https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_bd4f2f3c60cf6c3d0e65885030abf744.jpg',
                'https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_5961c9da61db270f7ee56caf0f36917c.jpg',
                'https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_ec572b06c0ecdec6857f08047755f302.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79725108-306b-5845-996a-5adf09913893/79725108-306b-5845-996a-5adf09913893_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_6ce3ea07970bb131f84831280eae6a6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79725108-306b-5845-996a-5adf09913893/79725108-306b-5845-996a-5adf09913893_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_0504de997e67dcfd4f4355abfa517eb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79725108-306b-5845-996a-5adf09913893/79725108-306b-5845-996a-5adf09913893_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_bd4f2f3c60cf6c3d0e65885030abf744.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79725108-306b-5845-996a-5adf09913893/79725108-306b-5845-996a-5adf09913893_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_5961c9da61db270f7ee56caf0f36917c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79725108-306b-5845-996a-5adf09913893/79725108-306b-5845-996a-5adf09913893_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/bc/e5bcb94543384972c940e1dc48b5ff99/pa/CF41480_ec572b06c0ecdec6857f08047755f302.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Alfa 159 2.0 JTDM',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF41480%27 HTTP/1.1" 200 None
2026-03-30 09:01:22 [auto1.it] INFO: Saving data for CF41480: {'created_time': 1774861282.896623, 'last_price_update_time': 1774861282.896636, 'auction_closing_time': 1774971461.0}
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CF41480') HTTP/1.1" 204 0
2026-03-30 09:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_f9cf1de9bb18ff4f006751522a0c0f90.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 830757a7-77c7-57b0-a5b6-918edfc4b923 with identifier: DE35632
2026-03-30 09:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 830757a7-77c7-57b0-a5b6-918edfc4b923 with identifier: DE35632
2026-03-30 09:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 830757a7-77c7-57b0-a5b6-918edfc4b923 with identifier: DE35632 to the API
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:47:41Z',
 'fuel_type': 'diesel',
 'id': '830757a7-77c7-57b0-a5b6-918edfc4b923',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE35632',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 176461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-26',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE35632%27 HTTP/1.1" 200 None
2026-03-30 09:01:23 [auto1.it] INFO: Saving data for DE35632: {'auction_closing_time': 1774972061.0, 'created_time': 1774360868.350103, 'last_price_update_time': 1774861283.336868}
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DE35632') HTTP/1.1" 204 0
2026-03-30 09:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM45638> (referer: https://www.auto1.com/v1/car-details-view/GM45638/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0f23c72-956e-518a-872c-12a645d1b4b3 with identifier: NB05481
2026-03-30 09:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0f23c72-956e-518a-872c-12a645d1b4b3 with scrape type 1
2026-03-30 09:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0f23c72-956e-518a-872c-12a645d1b4b3
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd1%252F9fd1237ad9198d6a8357fd2333ed1aa4%252Fpa%252FNB05481_c8a09550c228854b9a609634d08087fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_c8a09550c228854b9a609634d08087fe.jpg already downloaded
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd1%252F9fd1237ad9198d6a8357fd2333ed1aa4%252Fpa%252FNB05481_b6d53fe6cead788c556418a0cb3353a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_b6d53fe6cead788c556418a0cb3353a0.jpg already downloaded
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd1%252F9fd1237ad9198d6a8357fd2333ed1aa4%252Fpa%252FNB05481_6c60baf5b6a34469d0403725921d8bc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_6c60baf5b6a34469d0403725921d8bc7.jpg already downloaded
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd1%252F9fd1237ad9198d6a8357fd2333ed1aa4%252Fpa%252FNB05481_b679762da17737c9fa2549bb6e4aab6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_b679762da17737c9fa2549bb6e4aab6e.jpg already downloaded
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd1%252F9fd1237ad9198d6a8357fd2333ed1aa4%252Fpa%252FNB05481_59fe59e9db3e4e58c9f199dd821dad61.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_59fe59e9db3e4e58c9f199dd821dad61.jpg already downloaded
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd1%252F9fd1237ad9198d6a8357fd2333ed1aa4%252Fpa%252FNB05481_e9ed231ff545af42f0990f380710032d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_e9ed231ff545af42f0990f380710032d.jpg already downloaded
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd1%252F9fd1237ad9198d6a8357fd2333ed1aa4%252Fpa%252FNB05481_a2132aa971b0a425e55a36e4708edc86.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_a2132aa971b0a425e55a36e4708edc86.jpg already downloaded
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd1%252F9fd1237ad9198d6a8357fd2333ed1aa4%252Fpa%252FNB05481_9de9afa56972ca2cc8d6bd7e94e423e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_9de9afa56972ca2cc8d6bd7e94e423e7.jpg already downloaded
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd1%252F9fd1237ad9198d6a8357fd2333ed1aa4%252Fpa%252FNB05481_161566160635288ca1f52d2f16816f41.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_161566160635288ca1f52d2f16816f41.jpg already downloaded
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd1%252F9fd1237ad9198d6a8357fd2333ed1aa4%252Fpa%252FNB05481_72194cc9d3428a54866e9b2c83cfe54a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_72194cc9d3428a54866e9b2c83cfe54a.jpg already downloaded
2026-03-30 09:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c0f23c72-956e-518a-872c-12a645d1b4b3, identifier: NB05481
2026-03-30 09:01:23 [auto1.it] INFO: Found listing with ID: WE26685
2026-03-30 09:01:23 [auto1.it] INFO: Found listing with ID: ME48508
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME48508%27 HTTP/1.1" 200 None
2026-03-30 09:01:23 [auto1.it] INFO: Scrape type for ME48508: 2
2026-03-30 09:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05ea8218-fc51-54ae-8fc7-713dc589fdbc with identifier: ME48508
2026-03-30 09:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05ea8218-fc51-54ae-8fc7-713dc589fdbc with scrape type 2
2026-03-30 09:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05ea8218-fc51-54ae-8fc7-713dc589fdbc with scrape type 2
2026-03-30 09:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 05ea8218-fc51-54ae-8fc7-713dc589fdbc, identifier: ME48508
2026-03-30 09:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c0f23c72-956e-518a-872c-12a645d1b4b3 with identifier: NB05481
2026-03-30 09:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c0f23c72-956e-518a-872c-12a645d1b4b3 with identifier: NB05481
2026-03-30 09:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c0f23c72-956e-518a-872c-12a645d1b4b3 with identifier: NB05481 to the API
2026-03-30 09:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NB05481>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:25:27Z',
 'fuel_type': 'petrol',
 'id': 'c0f23c72-956e-518a-872c-12a645d1b4b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB05481',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 59984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_c8a09550c228854b9a609634d08087fe.jpg',
                'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_b6d53fe6cead788c556418a0cb3353a0.jpg',
                'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_6c60baf5b6a34469d0403725921d8bc7.jpg',
                'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_b679762da17737c9fa2549bb6e4aab6e.jpg',
                'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_59fe59e9db3e4e58c9f199dd821dad61.jpg',
                'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_e9ed231ff545af42f0990f380710032d.jpg',
                'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_a2132aa971b0a425e55a36e4708edc86.jpg',
                'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_9de9afa56972ca2cc8d6bd7e94e423e7.jpg',
                'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_161566160635288ca1f52d2f16816f41.jpg',
                'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_72194cc9d3428a54866e9b2c83cfe54a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f23c72-956e-518a-872c-12a645d1b4b3/c0f23c72-956e-518a-872c-12a645d1b4b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2644860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_c8a09550c228854b9a609634d08087fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f23c72-956e-518a-872c-12a645d1b4b3/c0f23c72-956e-518a-872c-12a645d1b4b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2616044,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_b6d53fe6cead788c556418a0cb3353a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f23c72-956e-518a-872c-12a645d1b4b3/c0f23c72-956e-518a-872c-12a645d1b4b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2354898,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_6c60baf5b6a34469d0403725921d8bc7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f23c72-956e-518a-872c-12a645d1b4b3/c0f23c72-956e-518a-872c-12a645d1b4b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2229644,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_b679762da17737c9fa2549bb6e4aab6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f23c72-956e-518a-872c-12a645d1b4b3/c0f23c72-956e-518a-872c-12a645d1b4b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_59fe59e9db3e4e58c9f199dd821dad61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f23c72-956e-518a-872c-12a645d1b4b3/c0f23c72-956e-518a-872c-12a645d1b4b3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_e9ed231ff545af42f0990f380710032d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f23c72-956e-518a-872c-12a645d1b4b3/c0f23c72-956e-518a-872c-12a645d1b4b3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_a2132aa971b0a425e55a36e4708edc86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f23c72-956e-518a-872c-12a645d1b4b3/c0f23c72-956e-518a-872c-12a645d1b4b3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2602941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_9de9afa56972ca2cc8d6bd7e94e423e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f23c72-956e-518a-872c-12a645d1b4b3/c0f23c72-956e-518a-872c-12a645d1b4b3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2503914,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_161566160635288ca1f52d2f16816f41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f23c72-956e-518a-872c-12a645d1b4b3/c0f23c72-956e-518a-872c-12a645d1b4b3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370361,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d1/9fd1237ad9198d6a8357fd2333ed1aa4/pa/NB05481_72194cc9d3428a54866e9b2c83cfe54a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 SCe Streetway Comfort',
 'transmission': 'manual',
 'trim': 'Streetway Comfort',
 'year': 2020}
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB05481%27 HTTP/1.1" 200 None
2026-03-30 09:01:24 [auto1.it] INFO: Saving data for NB05481: {'created_time': 1774861284.145782, 'last_price_update_time': 1774861284.145792, 'auction_closing_time': 1774970727.0}
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NB05481') HTTP/1.1" 204 0
2026-03-30 09:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 05ea8218-fc51-54ae-8fc7-713dc589fdbc with identifier: ME48508
2026-03-30 09:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 05ea8218-fc51-54ae-8fc7-713dc589fdbc with identifier: ME48508
2026-03-30 09:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 05ea8218-fc51-54ae-8fc7-713dc589fdbc with identifier: ME48508 to the API
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-31T15:02:45Z',
 'fuel_type': 'petrol',
 'id': '05ea8218-fc51-54ae-8fc7-713dc589fdbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME48508',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 8641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-11',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 DualJet Mild-Hybrid Top',
 'transmission': 'automatic',
 'trim': 'Top',
 'year': 2023}
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME48508%27 HTTP/1.1" 200 None
2026-03-30 09:01:24 [auto1.it] INFO: Saving data for ME48508: {'auction_closing_time': 1774969365.0, 'created_time': 1773327883.559043, 'last_price_update_time': 1774861284.578027}
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ME48508') HTTP/1.1" 204 0
2026-03-30 09:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30541127-2246-5fa8-9137-5c6342cb9cbd with identifier: KL21440
2026-03-30 09:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30541127-2246-5fa8-9137-5c6342cb9cbd with scrape type 1
2026-03-30 09:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 30541127-2246-5fa8-9137-5c6342cb9cbd
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fc9%252Feec972f895cdddac1ae72fc649442a97%252Fpa%252FKL21440_05d2fac9482256f8b6853c9d0aad0d74.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_05d2fac9482256f8b6853c9d0aad0d74.jpg already downloaded
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fc9%252Feec972f895cdddac1ae72fc649442a97%252Fpa%252FKL21440_2dcb8a42ca0f650e94f63d7cba6c5cef.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_2dcb8a42ca0f650e94f63d7cba6c5cef.jpg already downloaded
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fc9%252Feec972f895cdddac1ae72fc649442a97%252Fpa%252FKL21440_787fd097853b9c088a98e02d0948fffc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_787fd097853b9c088a98e02d0948fffc.jpg already downloaded
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fc9%252Feec972f895cdddac1ae72fc649442a97%252Fpa%252FKL21440_a52d73c472a0cda406e9224a4717c9db.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_a52d73c472a0cda406e9224a4717c9db.jpg already downloaded
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fc9%252Feec972f895cdddac1ae72fc649442a97%252Fpa%252FKL21440_b95732c95c6e9a4b76b6ffff0a1c6f97.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_b95732c95c6e9a4b76b6ffff0a1c6f97.jpg already downloaded
2026-03-30 09:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 30541127-2246-5fa8-9137-5c6342cb9cbd, identifier: KL21440
2026-03-30 09:01:24 [auto1.it] INFO: Found listing with ID: MA55202
2026-03-30 09:01:24 [auto1.it] INFO: Found listing with ID: LV15900
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV15900%27 HTTP/1.1" 200 None
2026-03-30 09:01:24 [auto1.it] INFO: Scrape type for LV15900: 2
2026-03-30 09:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e348d760-602b-56be-8978-1c7e55e6e21f with identifier: LV15900
2026-03-30 09:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e348d760-602b-56be-8978-1c7e55e6e21f with scrape type 2
2026-03-30 09:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e348d760-602b-56be-8978-1c7e55e6e21f with scrape type 2
2026-03-30 09:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e348d760-602b-56be-8978-1c7e55e6e21f, identifier: LV15900
2026-03-30 09:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 30541127-2246-5fa8-9137-5c6342cb9cbd with identifier: KL21440
2026-03-30 09:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 30541127-2246-5fa8-9137-5c6342cb9cbd with identifier: KL21440
2026-03-30 09:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 30541127-2246-5fa8-9137-5c6342cb9cbd with identifier: KL21440 to the API
2026-03-30 09:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KL21440>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:48:53Z',
 'fuel_type': 'petrol',
 'id': '30541127-2246-5fa8-9137-5c6342cb9cbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL21440',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 203830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_05d2fac9482256f8b6853c9d0aad0d74.jpg',
                'https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_2dcb8a42ca0f650e94f63d7cba6c5cef.jpg',
                'https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_787fd097853b9c088a98e02d0948fffc.jpg',
                'https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_a52d73c472a0cda406e9224a4717c9db.jpg',
                'https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_b95732c95c6e9a4b76b6ffff0a1c6f97.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30541127-2246-5fa8-9137-5c6342cb9cbd/30541127-2246-5fa8-9137-5c6342cb9cbd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_05d2fac9482256f8b6853c9d0aad0d74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30541127-2246-5fa8-9137-5c6342cb9cbd/30541127-2246-5fa8-9137-5c6342cb9cbd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_2dcb8a42ca0f650e94f63d7cba6c5cef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30541127-2246-5fa8-9137-5c6342cb9cbd/30541127-2246-5fa8-9137-5c6342cb9cbd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_787fd097853b9c088a98e02d0948fffc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30541127-2246-5fa8-9137-5c6342cb9cbd/30541127-2246-5fa8-9137-5c6342cb9cbd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_a52d73c472a0cda406e9224a4717c9db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30541127-2246-5fa8-9137-5c6342cb9cbd/30541127-2246-5fa8-9137-5c6342cb9cbd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/c9/eec972f895cdddac1ae72fc649442a97/pa/KL21440_b95732c95c6e9a4b76b6ffff0a1c6f97.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 09:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL21440%27 HTTP/1.1" 200 None
2026-03-30 09:01:25 [auto1.it] INFO: Saving data for KL21440: {'created_time': 1774861285.324738, 'last_price_update_time': 1774861285.324754, 'auction_closing_time': 1774972133.0}
2026-03-30 09:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KL21440') HTTP/1.1" 204 0
2026-03-30 09:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e348d760-602b-56be-8978-1c7e55e6e21f with identifier: LV15900
2026-03-30 09:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e348d760-602b-56be-8978-1c7e55e6e21f with identifier: LV15900
2026-03-30 09:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e348d760-602b-56be-8978-1c7e55e6e21f with identifier: LV15900 to the API
2026-03-30 09:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:25:11Z',
 'fuel_type': 'diesel',
 'id': 'e348d760-602b-56be-8978-1c7e55e6e21f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV15900',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 224368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-16',
 'seller_name': None,
 'title': 'Volvo V60 1.6 D Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2015}
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV15900%27 HTTP/1.1" 200 None
2026-03-30 09:01:26 [auto1.it] INFO: Saving data for LV15900: {'auction_closing_time': 1774970711.0, 'created_time': 1774342940.061641, 'last_price_update_time': 1774861286.281143}
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LV15900') HTTP/1.1" 204 0
2026-03-30 09:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA85498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_1efa4ee5011c0686158033e44b1cc722.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_eff7e7e72c48df04bb82a17b7fdfcecc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:26 [auto1.it] INFO: Found listing with ID: NV20276
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV20276%27 HTTP/1.1" 200 None
2026-03-30 09:01:26 [auto1.it] INFO: Scrape type for NV20276: 2
2026-03-30 09:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba508ff1-ef14-5fae-a436-44c6a107ccc8 with identifier: NV20276
2026-03-30 09:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba508ff1-ef14-5fae-a436-44c6a107ccc8 with scrape type 2
2026-03-30 09:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba508ff1-ef14-5fae-a436-44c6a107ccc8 with scrape type 2
2026-03-30 09:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ba508ff1-ef14-5fae-a436-44c6a107ccc8, identifier: NV20276
2026-03-30 09:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06256b10>
2026-03-30 09:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_f9cf1de9bb18ff4f006751522a0c0f90.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_f9cf1de9bb18ff4f006751522a0c0f90.jpg saved to cache
2026-03-30 09:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8fe3c62-8193-5792-81f3-d786995a17cf
2026-03-30 09:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f368433-1126-5740-99be-d188c6a84c18 with identifier: GM45638
2026-03-30 09:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f368433-1126-5740-99be-d188c6a84c18 with scrape type 1
2026-03-30 09:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f368433-1126-5740-99be-d188c6a84c18
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_dea0505fc2c24ffddf9d26ac30bd22c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_dea0505fc2c24ffddf9d26ac30bd22c7.jpg not downloaded yet
2026-03-30 09:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ba508ff1-ef14-5fae-a436-44c6a107ccc8 with identifier: NV20276
2026-03-30 09:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ba508ff1-ef14-5fae-a436-44c6a107ccc8 with identifier: NV20276
2026-03-30 09:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ba508ff1-ef14-5fae-a436-44c6a107ccc8 with identifier: NV20276 to the API
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-31T15:20:14Z',
 'fuel_type': 'petrol',
 'id': 'ba508ff1-ef14-5fae-a436-44c6a107ccc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV20276',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 49566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-05',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV20276%27 HTTP/1.1" 200 None
2026-03-30 09:01:27 [auto1.it] INFO: Saving data for NV20276: {'auction_closing_time': 1774970414.0, 'created_time': 1773139737.319978, 'last_price_update_time': 1774861287.014656}
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NV20276') HTTP/1.1" 204 0
2026-03-30 09:01:27 [auto1.it] INFO: Found listing with ID: TH12269
2026-03-30 09:01:27 [auto1.it] INFO: Found listing with ID: XV48493
2026-03-30 09:01:27 [auto1.it] INFO: Found listing with ID: EE49908
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE49908%27 HTTP/1.1" 200 None
2026-03-30 09:01:27 [auto1.it] INFO: Scrape type for EE49908: 2
2026-03-30 09:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af912ea5-cc0f-5a5e-a47f-c2f927a13ade with identifier: EE49908
2026-03-30 09:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af912ea5-cc0f-5a5e-a47f-c2f927a13ade with scrape type 2
2026-03-30 09:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af912ea5-cc0f-5a5e-a47f-c2f927a13ade with scrape type 2
2026-03-30 09:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af912ea5-cc0f-5a5e-a47f-c2f927a13ade, identifier: EE49908
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_44fd678c8fa4ab3807103cba6be65d39.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_44fd678c8fa4ab3807103cba6be65d39.jpg not downloaded yet
2026-03-30 09:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af912ea5-cc0f-5a5e-a47f-c2f927a13ade with identifier: EE49908
2026-03-30 09:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af912ea5-cc0f-5a5e-a47f-c2f927a13ade with identifier: EE49908
2026-03-30 09:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af912ea5-cc0f-5a5e-a47f-c2f927a13ade with identifier: EE49908 to the API
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-31T15:21:47Z',
 'fuel_type': 'diesel',
 'id': 'af912ea5-cc0f-5a5e-a47f-c2f927a13ade',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE49908',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 185540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-06',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B5 Diesel Mild-Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2020}
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE49908%27 HTTP/1.1" 200 None
2026-03-30 09:01:27 [auto1.it] INFO: Saving data for EE49908: {'auction_closing_time': 1774970507.0, 'created_time': 1774472428.93951, 'last_price_update_time': 1774861287.558007}
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EE49908') HTTP/1.1" 204 0
2026-03-30 09:01:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d58a10>
2026-03-30 09:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_1efa4ee5011c0686158033e44b1cc722.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_1efa4ee5011c0686158033e44b1cc722.jpg saved to cache
2026-03-30 09:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b
2026-03-30 09:01:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ff4c90>
2026-03-30 09:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_eff7e7e72c48df04bb82a17b7fdfcecc.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_eff7e7e72c48df04bb82a17b7fdfcecc.jpg saved to cache
2026-03-30 09:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b
2026-03-30 09:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_401efd59c31819af9c0e63ec538e6993.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:27 [auto1.it] INFO: Found listing with ID: KS95421
2026-03-30 09:01:27 [auto1.it] INFO: Found listing with ID: DF93704
2026-03-30 09:01:27 [auto1.it] INFO: Found listing with ID: TE47811
2026-03-30 09:01:27 [auto1.it] INFO: Found listing with ID: GE96866
2026-03-30 09:01:27 [auto1.it] INFO: Found listing with ID: LK09614
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK09614%27 HTTP/1.1" 200 None
2026-03-30 09:01:27 [auto1.it] INFO: Scrape type for LK09614: 2
2026-03-30 09:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fefe6ea5-64bb-50d3-84a4-34b3ec401eb3 with identifier: LK09614
2026-03-30 09:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fefe6ea5-64bb-50d3-84a4-34b3ec401eb3 with scrape type 2
2026-03-30 09:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fefe6ea5-64bb-50d3-84a4-34b3ec401eb3 with scrape type 2
2026-03-30 09:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fefe6ea5-64bb-50d3-84a4-34b3ec401eb3, identifier: LK09614
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_2f45b53274816250cc29a2ae8fe041db.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_2f45b53274816250cc29a2ae8fe041db.jpg not downloaded yet
2026-03-30 09:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fefe6ea5-64bb-50d3-84a4-34b3ec401eb3 with identifier: LK09614
2026-03-30 09:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fefe6ea5-64bb-50d3-84a4-34b3ec401eb3 with identifier: LK09614
2026-03-30 09:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fefe6ea5-64bb-50d3-84a4-34b3ec401eb3 with identifier: LK09614 to the API
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:49:53Z',
 'fuel_type': 'diesel',
 'id': 'fefe6ea5-64bb-50d3-84a4-34b3ec401eb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK09614',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 90253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-19',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 2.0 TD Sd4 SD4 HSE',
 'transmission': 'automatic',
 'trim': 'SD4 HSE',
 'year': 2018}
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK09614%27 HTTP/1.1" 200 None
2026-03-30 09:01:28 [auto1.it] INFO: Saving data for LK09614: {'auction_closing_time': 1774972193.0, 'created_time': 1774386038.211085, 'last_price_update_time': 1774861288.547497}
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LK09614') HTTP/1.1" 204 0
2026-03-30 09:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_52b7b6e9c86f371f9cb8ccdf16c726e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:28 [auto1.it] INFO: Found listing with ID: HU36164
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU36164%27 HTTP/1.1" 200 None
2026-03-30 09:01:28 [auto1.it] INFO: Scrape type for HU36164: 2
2026-03-30 09:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 475851cb-4dc3-5c64-8618-cbd4a7f9da97 with identifier: HU36164
2026-03-30 09:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 475851cb-4dc3-5c64-8618-cbd4a7f9da97 with scrape type 2
2026-03-30 09:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 475851cb-4dc3-5c64-8618-cbd4a7f9da97 with scrape type 2
2026-03-30 09:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 475851cb-4dc3-5c64-8618-cbd4a7f9da97, identifier: HU36164
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_dfad3cc1e0677ee699c15e27103c201c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_dfad3cc1e0677ee699c15e27103c201c.jpg not downloaded yet
2026-03-30 09:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ25588> (referer: https://www.auto1.com/v1/car-details-view/JZ25588/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 475851cb-4dc3-5c64-8618-cbd4a7f9da97 with identifier: HU36164
2026-03-30 09:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 475851cb-4dc3-5c64-8618-cbd4a7f9da97 with identifier: HU36164
2026-03-30 09:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 475851cb-4dc3-5c64-8618-cbd4a7f9da97 with identifier: HU36164 to the API
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:49:19Z',
 'fuel_type': 'petrol',
 'id': '475851cb-4dc3-5c64-8618-cbd4a7f9da97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU36164',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 238106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-21',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2010}
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU36164%27 HTTP/1.1" 200 None
2026-03-30 09:01:29 [auto1.it] INFO: Saving data for HU36164: {'auction_closing_time': 1774972159.0, 'created_time': 1774386070.011253, 'last_price_update_time': 1774861289.029007}
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU36164') HTTP/1.1" 204 0
2026-03-30 09:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06369590>
2026-03-30 09:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_401efd59c31819af9c0e63ec538e6993.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_401efd59c31819af9c0e63ec538e6993.jpg saved to cache
2026-03-30 09:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8fe3c62-8193-5792-81f3-d786995a17cf
2026-03-30 09:01:29 [auto1.it] INFO: Found listing with ID: GR02262
2026-03-30 09:01:29 [auto1.it] INFO: Found listing with ID: DS64702
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS64702%27 HTTP/1.1" 200 None
2026-03-30 09:01:29 [auto1.it] INFO: Scrape type for DS64702: 2
2026-03-30 09:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0110b98-18c6-5a4f-9b08-5b22c0b873e1 with identifier: DS64702
2026-03-30 09:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0110b98-18c6-5a4f-9b08-5b22c0b873e1 with scrape type 2
2026-03-30 09:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0110b98-18c6-5a4f-9b08-5b22c0b873e1 with scrape type 2
2026-03-30 09:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f0110b98-18c6-5a4f-9b08-5b22c0b873e1, identifier: DS64702
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_f96afb63991fe7c7e104a71a16be19f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_f96afb63991fe7c7e104a71a16be19f9.jpg not downloaded yet
2026-03-30 09:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP37847> (referer: https://www.auto1.com/v1/car-details-view/HP37847/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f0110b98-18c6-5a4f-9b08-5b22c0b873e1 with identifier: DS64702
2026-03-30 09:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f0110b98-18c6-5a4f-9b08-5b22c0b873e1 with identifier: DS64702
2026-03-30 09:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f0110b98-18c6-5a4f-9b08-5b22c0b873e1 with identifier: DS64702 to the API
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:23:59Z',
 'fuel_type': 'hybrid',
 'id': 'f0110b98-18c6-5a4f-9b08-5b22c0b873e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS64702',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'CT-Serie',
 'odometer': 137351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-26',
 'seller_name': None,
 'title': 'Lexus CT-Serie CT 200h Executive Line',
 'transmission': 'automatic',
 'trim': 'Executive Line',
 'year': 2014}
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS64702%27 HTTP/1.1" 200 None
2026-03-30 09:01:29 [auto1.it] INFO: Saving data for DS64702: {'auction_closing_time': 1774970639.0, 'created_time': 1774472428.537805, 'last_price_update_time': 1774861289.696067}
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DS64702') HTTP/1.1" 204 0
2026-03-30 09:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:29 [auto1.it] INFO: Found listing with ID: PF04390
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF04390%27 HTTP/1.1" 200 None
2026-03-30 09:01:29 [auto1.it] INFO: Scrape type for PF04390: 1
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_9c6ea5f39b558bd3b102d701e45ee124.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_9c6ea5f39b558bd3b102d701e45ee124.jpg not downloaded yet
2026-03-30 09:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL10517> (referer: https://www.auto1.com/v1/car-details-view/CL10517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP53767> (referer: https://www.auto1.com/v1/car-details-view/NP53767/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c69f90>
2026-03-30 09:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_52b7b6e9c86f371f9cb8ccdf16c726e4.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_52b7b6e9c86f371f9cb8ccdf16c726e4.jpg saved to cache
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b
2026-03-30 09:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 938b03b0-ec48-53ae-9ac5-685f99a96cfb with identifier: JZ25588
2026-03-30 09:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 938b03b0-ec48-53ae-9ac5-685f99a96cfb with scrape type 1
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 938b03b0-ec48-53ae-9ac5-685f99a96cfb
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fcf%252F41cfdeea77a1fac432ae4746dba3a8d1%252Fpa%252FJZ25588_6da41404b33c41941f2096dd40bb3e9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_6da41404b33c41941f2096dd40bb3e9b.jpg already downloaded
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fcf%252F41cfdeea77a1fac432ae4746dba3a8d1%252Fpa%252FJZ25588_5625f87f05405d9e175c5ae960ab1f79.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_5625f87f05405d9e175c5ae960ab1f79.jpg already downloaded
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fcf%252F41cfdeea77a1fac432ae4746dba3a8d1%252Fpa%252FJZ25588_4fa771620ec2ff408e6c48ba66ff163c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_4fa771620ec2ff408e6c48ba66ff163c.jpg already downloaded
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fcf%252F41cfdeea77a1fac432ae4746dba3a8d1%252Fpa%252FJZ25588_513cd108d0999dc91e9e1289b501c3ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_513cd108d0999dc91e9e1289b501c3ab.jpg already downloaded
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fcf%252F41cfdeea77a1fac432ae4746dba3a8d1%252Fpa%252FJZ25588_d234d04746daebc7b7ba04e6651a3615.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_d234d04746daebc7b7ba04e6651a3615.jpg already downloaded
2026-03-30 09:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 938b03b0-ec48-53ae-9ac5-685f99a96cfb, identifier: JZ25588
2026-03-30 09:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_2f45b53274816250cc29a2ae8fe041db.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK19595/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 938b03b0-ec48-53ae-9ac5-685f99a96cfb with identifier: JZ25588
2026-03-30 09:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 938b03b0-ec48-53ae-9ac5-685f99a96cfb with identifier: JZ25588
2026-03-30 09:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 938b03b0-ec48-53ae-9ac5-685f99a96cfb with identifier: JZ25588 to the API
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JZ25588>
{'auction_title': '',
 'c_o_2_emission_value': 250,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.7L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:55:58Z',
 'fuel_type': 'diesel',
 'id': '938b03b0-ec48-53ae-9ac5-685f99a96cfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ25588',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 268932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_6da41404b33c41941f2096dd40bb3e9b.jpg',
                'https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_5625f87f05405d9e175c5ae960ab1f79.jpg',
                'https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_4fa771620ec2ff408e6c48ba66ff163c.jpg',
                'https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_513cd108d0999dc91e9e1289b501c3ab.jpg',
                'https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_d234d04746daebc7b7ba04e6651a3615.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938b03b0-ec48-53ae-9ac5-685f99a96cfb/938b03b0-ec48-53ae-9ac5-685f99a96cfb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_6da41404b33c41941f2096dd40bb3e9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938b03b0-ec48-53ae-9ac5-685f99a96cfb/938b03b0-ec48-53ae-9ac5-685f99a96cfb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_5625f87f05405d9e175c5ae960ab1f79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938b03b0-ec48-53ae-9ac5-685f99a96cfb/938b03b0-ec48-53ae-9ac5-685f99a96cfb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_4fa771620ec2ff408e6c48ba66ff163c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938b03b0-ec48-53ae-9ac5-685f99a96cfb/938b03b0-ec48-53ae-9ac5-685f99a96cfb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_513cd108d0999dc91e9e1289b501c3ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938b03b0-ec48-53ae-9ac5-685f99a96cfb/938b03b0-ec48-53ae-9ac5-685f99a96cfb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/cf/41cfdeea77a1fac432ae4746dba3a8d1/pa/JZ25588_d234d04746daebc7b7ba04e6651a3615.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 270 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2002}
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ25588%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [auto1.it] INFO: Saving data for JZ25588: {'created_time': 1774861290.673213, 'last_price_update_time': 1774861290.673226, 'auction_closing_time': 1774972558.0}
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ25588') HTTP/1.1" 204 0
2026-03-30 09:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_44fd678c8fa4ab3807103cba6be65d39.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:30 [auto1.it] INFO: Found listing with ID: YX59353
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX59353%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [auto1.it] INFO: Scrape type for YX59353: 1
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_a7d93b0814fa951ef803ee5eff21325c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_a7d93b0814fa951ef803ee5eff21325c.jpg not downloaded yet
2026-03-30 09:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66d0409e-e843-5296-b005-9b2d8b4afd4c with identifier: HP37847
2026-03-30 09:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d0409e-e843-5296-b005-9b2d8b4afd4c with scrape type 1
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66d0409e-e843-5296-b005-9b2d8b4afd4c
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1b%252F8d1bef52b7c99f2b284c27774d0f9811%252Fpa%252FHP37847_9368871f0b7736180ea933dcdbf83515.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_9368871f0b7736180ea933dcdbf83515.jpg already downloaded
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1b%252F8d1bef52b7c99f2b284c27774d0f9811%252Fpa%252FHP37847_8691252ccf40e1bf803f964066095436.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_8691252ccf40e1bf803f964066095436.jpg already downloaded
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1b%252F8d1bef52b7c99f2b284c27774d0f9811%252Fpa%252FHP37847_b8f1dd97dc5c7b12a21dfc972bf7b126.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_b8f1dd97dc5c7b12a21dfc972bf7b126.jpg already downloaded
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1b%252F8d1bef52b7c99f2b284c27774d0f9811%252Fpa%252FHP37847_6558e6a6428b982b696d4306478489ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_6558e6a6428b982b696d4306478489ba.jpg already downloaded
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1b%252F8d1bef52b7c99f2b284c27774d0f9811%252Fpa%252FHP37847_d1ceeff985d02362ecf08b9784ea6ea1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_d1ceeff985d02362ecf08b9784ea6ea1.jpg already downloaded
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1b%252F8d1bef52b7c99f2b284c27774d0f9811%252Fpa%252FHP37847_f85cb9583643d91d6e7f512792d65212.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_f85cb9583643d91d6e7f512792d65212.jpg already downloaded
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1b%252F8d1bef52b7c99f2b284c27774d0f9811%252Fpa%252FHP37847_ab5dcdb90932549e2a504b37adf19072.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_ab5dcdb90932549e2a504b37adf19072.jpg already downloaded
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1b%252F8d1bef52b7c99f2b284c27774d0f9811%252Fpa%252FHP37847_5e7e911c3ac98682de78af0de834fb24.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_5e7e911c3ac98682de78af0de834fb24.jpg already downloaded
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1b%252F8d1bef52b7c99f2b284c27774d0f9811%252Fpa%252FHP37847_451d313defdaea6bb6e8a283d2418f9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_451d313defdaea6bb6e8a283d2418f9d.jpg already downloaded
2026-03-30 09:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1b%252F8d1bef52b7c99f2b284c27774d0f9811%252Fpa%252FHP37847_2ddf0fcb0dd1c354597298ce8cd2847f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_2ddf0fcb0dd1c354597298ce8cd2847f.jpg already downloaded
2026-03-30 09:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 66d0409e-e843-5296-b005-9b2d8b4afd4c, identifier: HP37847
2026-03-30 09:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ37544> (referer: https://www.auto1.com/v1/car-details-view/ZZ37544/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 66d0409e-e843-5296-b005-9b2d8b4afd4c with identifier: HP37847
2026-03-30 09:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 66d0409e-e843-5296-b005-9b2d8b4afd4c with identifier: HP37847
2026-03-30 09:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 66d0409e-e843-5296-b005-9b2d8b4afd4c with identifier: HP37847 to the API
2026-03-30 09:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HP37847>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:03:25Z',
 'fuel_type': 'diesel',
 'id': '66d0409e-e843-5296-b005-9b2d8b4afd4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP37847',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'BMW',
 'model': '5er',
 'odometer': 422086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_9368871f0b7736180ea933dcdbf83515.jpg',
                'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_8691252ccf40e1bf803f964066095436.jpg',
                'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_b8f1dd97dc5c7b12a21dfc972bf7b126.jpg',
                'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_6558e6a6428b982b696d4306478489ba.jpg',
                'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_d1ceeff985d02362ecf08b9784ea6ea1.jpg',
                'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_f85cb9583643d91d6e7f512792d65212.jpg',
                'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_ab5dcdb90932549e2a504b37adf19072.jpg',
                'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_5e7e911c3ac98682de78af0de834fb24.jpg',
                'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_451d313defdaea6bb6e8a283d2418f9d.jpg',
                'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_2ddf0fcb0dd1c354597298ce8cd2847f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66d0409e-e843-5296-b005-9b2d8b4afd4c/66d0409e-e843-5296-b005-9b2d8b4afd4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3037767,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_9368871f0b7736180ea933dcdbf83515.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66d0409e-e843-5296-b005-9b2d8b4afd4c/66d0409e-e843-5296-b005-9b2d8b4afd4c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3020564,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_8691252ccf40e1bf803f964066095436.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66d0409e-e843-5296-b005-9b2d8b4afd4c/66d0409e-e843-5296-b005-9b2d8b4afd4c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2935374,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_b8f1dd97dc5c7b12a21dfc972bf7b126.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66d0409e-e843-5296-b005-9b2d8b4afd4c/66d0409e-e843-5296-b005-9b2d8b4afd4c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2953469,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_6558e6a6428b982b696d4306478489ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66d0409e-e843-5296-b005-9b2d8b4afd4c/66d0409e-e843-5296-b005-9b2d8b4afd4c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2908754,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_d1ceeff985d02362ecf08b9784ea6ea1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66d0409e-e843-5296-b005-9b2d8b4afd4c/66d0409e-e843-5296-b005-9b2d8b4afd4c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3023263,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_f85cb9583643d91d6e7f512792d65212.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66d0409e-e843-5296-b005-9b2d8b4afd4c/66d0409e-e843-5296-b005-9b2d8b4afd4c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2917020,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_ab5dcdb90932549e2a504b37adf19072.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66d0409e-e843-5296-b005-9b2d8b4afd4c/66d0409e-e843-5296-b005-9b2d8b4afd4c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3136395,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_5e7e911c3ac98682de78af0de834fb24.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66d0409e-e843-5296-b005-9b2d8b4afd4c/66d0409e-e843-5296-b005-9b2d8b4afd4c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2871185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_451d313defdaea6bb6e8a283d2418f9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66d0409e-e843-5296-b005-9b2d8b4afd4c/66d0409e-e843-5296-b005-9b2d8b4afd4c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1b/8d1bef52b7c99f2b284c27774d0f9811/pa/HP37847_2ddf0fcb0dd1c354597298ce8cd2847f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 09:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP37847%27 HTTP/1.1" 200 None
2026-03-30 09:01:31 [auto1.it] INFO: Saving data for HP37847: {'created_time': 1774861291.890505, 'last_price_update_time': 1774861291.890518, 'auction_closing_time': 1774969405.0}
2026-03-30 09:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HP37847') HTTP/1.1" 204 0
2026-03-30 09:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 530d4275-298b-5e92-b175-74a3620a07f9 with identifier: CL10517
2026-03-30 09:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 530d4275-298b-5e92-b175-74a3620a07f9 with scrape type 1
2026-03-30 09:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 530d4275-298b-5e92-b175-74a3620a07f9
2026-03-30 09:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe9%252Fc4e96809ea176ae85a9f3d87f1a19eb0%252Fpa%252FCL10517_a44c6013182a1ecc26a38bc6c574e59e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_a44c6013182a1ecc26a38bc6c574e59e.jpg not downloaded yet
2026-03-30 09:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a998de2d-1060-5046-bfb5-eaa4b85bacbb with identifier: NP53767
2026-03-30 09:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a998de2d-1060-5046-bfb5-eaa4b85bacbb with scrape type 1
2026-03-30 09:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a998de2d-1060-5046-bfb5-eaa4b85bacbb
2026-03-30 09:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_2ada8dca20abcf5d62d057f7b7a9b374.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_2ada8dca20abcf5d62d057f7b7a9b374.jpg not downloaded yet
2026-03-30 09:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_f96afb63991fe7c7e104a71a16be19f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:31 [auto1.it] INFO: Found listing with ID: MY23497
2026-03-30 09:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY23497%27 HTTP/1.1" 200 None
2026-03-30 09:01:31 [auto1.it] INFO: Scrape type for MY23497: 2
2026-03-30 09:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8540026-44c9-514f-a74f-959e3d20bb14 with identifier: MY23497
2026-03-30 09:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8540026-44c9-514f-a74f-959e3d20bb14 with scrape type 2
2026-03-30 09:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8540026-44c9-514f-a74f-959e3d20bb14 with scrape type 2
2026-03-30 09:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a8540026-44c9-514f-a74f-959e3d20bb14, identifier: MY23497
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_2f2fc80ef2207f848d0bace155cced7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_2f2fc80ef2207f848d0bace155cced7e.jpg not downloaded yet
2026-03-30 09:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_0bba5000217435d99236a965f6be0b50.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_dfad3cc1e0677ee699c15e27103c201c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_abdcfc2efc270531e9bb8e6a4858db33.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a8540026-44c9-514f-a74f-959e3d20bb14 with identifier: MY23497
2026-03-30 09:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a8540026-44c9-514f-a74f-959e3d20bb14 with identifier: MY23497
2026-03-30 09:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a8540026-44c9-514f-a74f-959e3d20bb14 with identifier: MY23497 to the API
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:19:21Z',
 'fuel_type': 'diesel',
 'id': 'a8540026-44c9-514f-a74f-959e3d20bb14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY23497',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 72367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY23497%27 HTTP/1.1" 200 None
2026-03-30 09:01:32 [auto1.it] INFO: Saving data for MY23497: {'auction_closing_time': 1774970361.0, 'created_time': 1774386227.629707, 'last_price_update_time': 1774861292.47895}
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MY23497') HTTP/1.1" 204 0
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe9%252Fc4e96809ea176ae85a9f3d87f1a19eb0%252Fpa%252FCL10517_673548e3ea75c4dae1c65e3406edd7f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_673548e3ea75c4dae1c65e3406edd7f0.jpg not downloaded yet
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_b75e5add0010340b0ddcc4e79f7179a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_b75e5add0010340b0ddcc4e79f7179a2.jpg not downloaded yet
2026-03-30 09:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e5f910>
2026-03-30 09:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_2f45b53274816250cc29a2ae8fe041db.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_2f45b53274816250cc29a2ae8fe041db.jpg saved to cache
2026-03-30 09:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f368433-1126-5740-99be-d188c6a84c18
2026-03-30 09:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cb4a90>
2026-03-30 09:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_44fd678c8fa4ab3807103cba6be65d39.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_44fd678c8fa4ab3807103cba6be65d39.jpg saved to cache
2026-03-30 09:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f368433-1126-5740-99be-d188c6a84c18
2026-03-30 09:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_dea0505fc2c24ffddf9d26ac30bd22c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:32 [auto1.it] INFO: Found listing with ID: WL38186
2026-03-30 09:01:32 [auto1.it] INFO: Found listing with ID: RX09361
2026-03-30 09:01:32 [auto1.it] INFO: Found listing with ID: XR03197
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR03197%27 HTTP/1.1" 200 None
2026-03-30 09:01:32 [auto1.it] INFO: Scrape type for XR03197: 2
2026-03-30 09:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 265e928f-31ed-5371-8e8b-a9769b6f6c19 with identifier: XR03197
2026-03-30 09:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 265e928f-31ed-5371-8e8b-a9769b6f6c19 with scrape type 2
2026-03-30 09:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 265e928f-31ed-5371-8e8b-a9769b6f6c19 with scrape type 2
2026-03-30 09:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 265e928f-31ed-5371-8e8b-a9769b6f6c19, identifier: XR03197
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_a45cc4bd951e373223d10d6cdc19ee0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_a45cc4bd951e373223d10d6cdc19ee0e.jpg not downloaded yet
2026-03-30 09:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 265e928f-31ed-5371-8e8b-a9769b6f6c19 with identifier: XR03197
2026-03-30 09:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 265e928f-31ed-5371-8e8b-a9769b6f6c19 with identifier: XR03197
2026-03-30 09:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 265e928f-31ed-5371-8e8b-a9769b6f6c19 with identifier: XR03197 to the API
2026-03-30 09:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:40:04Z',
 'fuel_type': 'petrol',
 'id': '265e928f-31ed-5371-8e8b-a9769b6f6c19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR03197',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 174306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-06-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2002}
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR03197%27 HTTP/1.1" 200 None
2026-03-30 09:01:33 [auto1.it] INFO: Saving data for XR03197: {'auction_closing_time': 1774971604.0, 'created_time': 1774559110.347034, 'last_price_update_time': 1774861293.153805}
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XR03197') HTTP/1.1" 204 0
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe9%252Fc4e96809ea176ae85a9f3d87f1a19eb0%252Fpa%252FCL10517_345767b1463b5d3c698f3458f19db69e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_345767b1463b5d3c698f3458f19db69e.jpg not downloaded yet
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_85d95cb053da054e702d688cae8f2cad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_85d95cb053da054e702d688cae8f2cad.jpg not downloaded yet
2026-03-30 09:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af38efeb-5cc6-51f7-90cf-d45670006072 with identifier: ZZ37544
2026-03-30 09:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af38efeb-5cc6-51f7-90cf-d45670006072 with scrape type 1
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af38efeb-5cc6-51f7-90cf-d45670006072
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_ebc667751ad390c9639355647cd5161b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_ebc667751ad390c9639355647cd5161b.jpg not downloaded yet
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063658d0>
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_f96afb63991fe7c7e104a71a16be19f9.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_f96afb63991fe7c7e104a71a16be19f9.jpg saved to cache
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f368433-1126-5740-99be-d188c6a84c18
2026-03-30 09:01:33 [auto1.it] INFO: Found listing with ID: JT52337
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT52337%27 HTTP/1.1" 200 None
2026-03-30 09:01:33 [auto1.it] INFO: Scrape type for JT52337: 2
2026-03-30 09:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89014a4d-5813-57a2-945e-e83216d0b46a with identifier: JT52337
2026-03-30 09:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89014a4d-5813-57a2-945e-e83216d0b46a with scrape type 2
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89014a4d-5813-57a2-945e-e83216d0b46a with scrape type 2
2026-03-30 09:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 89014a4d-5813-57a2-945e-e83216d0b46a, identifier: JT52337
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_e475a2ae8e15ef398b5ebd294283ed85.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_e475a2ae8e15ef398b5ebd294283ed85.jpg not downloaded yet
2026-03-30 09:01:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d06f010>
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_0bba5000217435d99236a965f6be0b50.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_0bba5000217435d99236a965f6be0b50.jpg saved to cache
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062f8a50>
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_dfad3cc1e0677ee699c15e27103c201c.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_dfad3cc1e0677ee699c15e27103c201c.jpg saved to cache
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f368433-1126-5740-99be-d188c6a84c18
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062f9550>
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_abdcfc2efc270531e9bb8e6a4858db33.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_abdcfc2efc270531e9bb8e6a4858db33.jpg saved to cache
2026-03-30 09:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8fe3c62-8193-5792-81f3-d786995a17cf
2026-03-30 09:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_a7d93b0814fa951ef803ee5eff21325c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_9c6ea5f39b558bd3b102d701e45ee124.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 89014a4d-5813-57a2-945e-e83216d0b46a with identifier: JT52337
2026-03-30 09:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 89014a4d-5813-57a2-945e-e83216d0b46a with identifier: JT52337
2026-03-30 09:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 89014a4d-5813-57a2-945e-e83216d0b46a with identifier: JT52337 to the API
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:16:00Z',
 'fuel_type': 'petrol',
 'id': '89014a4d-5813-57a2-945e-e83216d0b46a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT52337',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 99580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-26',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 09:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT52337%27 HTTP/1.1" 200 None
2026-03-30 09:01:34 [auto1.it] INFO: Saving data for JT52337: {'auction_closing_time': 1774970160.0, 'created_time': 1773954061.984279, 'last_price_update_time': 1774861294.002903}
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JT52337') HTTP/1.1" 204 0
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe9%252Fc4e96809ea176ae85a9f3d87f1a19eb0%252Fpa%252FCL10517_31c139fbe43ba533ec5b4faf44a41836.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_31c139fbe43ba533ec5b4faf44a41836.jpg not downloaded yet
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_2ab7ce252ac36903eb8faa24975439c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_2ab7ce252ac36903eb8faa24975439c8.jpg not downloaded yet
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_b9009952221f6f10e0ca5f348a9d8d80.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_b9009952221f6f10e0ca5f348a9d8d80.jpg not downloaded yet
2026-03-30 09:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_a44c6013182a1ecc26a38bc6c574e59e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_2ada8dca20abcf5d62d057f7b7a9b374.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:34 [auto1.it] INFO: Found listing with ID: LF83969
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF83969%27 HTTP/1.1" 200 None
2026-03-30 09:01:34 [auto1.it] INFO: Scrape type for LF83969: 2
2026-03-30 09:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 067cdc9a-9930-5c1f-8f45-85c175b0edf0 with identifier: LF83969
2026-03-30 09:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 067cdc9a-9930-5c1f-8f45-85c175b0edf0 with scrape type 2
2026-03-30 09:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 067cdc9a-9930-5c1f-8f45-85c175b0edf0 with scrape type 2
2026-03-30 09:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 067cdc9a-9930-5c1f-8f45-85c175b0edf0, identifier: LF83969
2026-03-30 09:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW12338> (referer: https://www.auto1.com/v1/car-details-view/JW12338/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062fab50>
2026-03-30 09:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_dea0505fc2c24ffddf9d26ac30bd22c7.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_dea0505fc2c24ffddf9d26ac30bd22c7.jpg saved to cache
2026-03-30 09:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f368433-1126-5740-99be-d188c6a84c18
2026-03-30 09:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_2f2fc80ef2207f848d0bace155cced7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 067cdc9a-9930-5c1f-8f45-85c175b0edf0 with identifier: LF83969
2026-03-30 09:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 067cdc9a-9930-5c1f-8f45-85c175b0edf0 with identifier: LF83969
2026-03-30 09:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 067cdc9a-9930-5c1f-8f45-85c175b0edf0 with identifier: LF83969 to the API
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-31T15:35:34Z',
 'fuel_type': 'hybrid',
 'id': '067cdc9a-9930-5c1f-8f45-85c175b0edf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF83969',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'NX-Serie',
 'odometer': 177466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-02',
 'seller_name': None,
 'title': 'Lexus NX-Serie NX 300h Executive Line',
 'transmission': 'automatic',
 'trim': 'Executive Line',
 'year': 2016}
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF83969%27 HTTP/1.1" 200 None
2026-03-30 09:01:34 [auto1.it] INFO: Saving data for LF83969: {'auction_closing_time': 1774971334.0, 'created_time': 1773663261.195062, 'last_price_update_time': 1774861294.982934}
2026-03-30 09:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LF83969') HTTP/1.1" 204 0
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe9%252Fc4e96809ea176ae85a9f3d87f1a19eb0%252Fpa%252FCL10517_789484c4496cfa3f8f4c001aaf365d9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_789484c4496cfa3f8f4c001aaf365d9d.jpg not downloaded yet
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_0ba88efd8c7ada1adaf29136af93bdf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_0ba88efd8c7ada1adaf29136af93bdf3.jpg not downloaded yet
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_2bd06ed62f15ce979f85b6668030a041.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_2bd06ed62f15ce979f85b6668030a041.jpg not downloaded yet
2026-03-30 09:01:35 [auto1.it] INFO: Found listing with ID: SJ27084
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ27084%27 HTTP/1.1" 200 None
2026-03-30 09:01:35 [auto1.it] INFO: Scrape type for SJ27084: 2
2026-03-30 09:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69fe4a92-622c-5ef3-8e4b-8a0801c13102 with identifier: SJ27084
2026-03-30 09:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69fe4a92-622c-5ef3-8e4b-8a0801c13102 with scrape type 2
2026-03-30 09:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69fe4a92-622c-5ef3-8e4b-8a0801c13102 with scrape type 2
2026-03-30 09:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 69fe4a92-622c-5ef3-8e4b-8a0801c13102, identifier: SJ27084
2026-03-30 09:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AP34592> (referer: https://www.auto1.com/v1/car-details-view/AP34592/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f5ee50>
2026-03-30 09:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_a7d93b0814fa951ef803ee5eff21325c.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_a7d93b0814fa951ef803ee5eff21325c.jpg saved to cache
2026-03-30 09:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f368433-1126-5740-99be-d188c6a84c18
2026-03-30 09:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06239690>
2026-03-30 09:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_9c6ea5f39b558bd3b102d701e45ee124.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_9c6ea5f39b558bd3b102d701e45ee124.jpg saved to cache
2026-03-30 09:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f368433-1126-5740-99be-d188c6a84c18
2026-03-30 09:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 69fe4a92-622c-5ef3-8e4b-8a0801c13102 with identifier: SJ27084
2026-03-30 09:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 69fe4a92-622c-5ef3-8e4b-8a0801c13102 with identifier: SJ27084
2026-03-30 09:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 69fe4a92-622c-5ef3-8e4b-8a0801c13102 with identifier: SJ27084 to the API
2026-03-30 09:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-31T15:32:08Z',
 'fuel_type': 'hybrid',
 'id': '69fe4a92-622c-5ef3-8e4b-8a0801c13102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ27084',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 64689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid R-Design 2WD',
 'transmission': 'automatic',
 'trim': 'R-Design 2WD',
 'year': 2022}
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ27084%27 HTTP/1.1" 200 None
2026-03-30 09:01:36 [auto1.it] INFO: Saving data for SJ27084: {'auction_closing_time': 1774971128.0, 'created_time': 1773268334.28044, 'last_price_update_time': 1774861296.195539}
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SJ27084') HTTP/1.1" 204 0
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_18d168f588211ddc34cc75a2cc411864.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_18d168f588211ddc34cc75a2cc411864.jpg not downloaded yet
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_148132731aab92c862f00314aeec6cd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_148132731aab92c862f00314aeec6cd0.jpg not downloaded yet
2026-03-30 09:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f4e110>
2026-03-30 09:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530d4275-298b-5e92-b175-74a3620a07f9/530d4275-298b-5e92-b175-74a3620a07f9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe9%252Fc4e96809ea176ae85a9f3d87f1a19eb0%252Fpa%252FCL10517_a44c6013182a1ecc26a38bc6c574e59e.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_a44c6013182a1ecc26a38bc6c574e59e.jpg saved to cache
2026-03-30 09:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 530d4275-298b-5e92-b175-74a3620a07f9
2026-03-30 09:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062c8550>
2026-03-30 09:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_2ada8dca20abcf5d62d057f7b7a9b374.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_2ada8dca20abcf5d62d057f7b7a9b374.jpg saved to cache
2026-03-30 09:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a998de2d-1060-5046-bfb5-eaa4b85bacbb
2026-03-30 09:01:36 [auto1.it] INFO: Found listing with ID: GA52227
2026-03-30 09:01:36 [auto1.it] INFO: Found listing with ID: DS88092
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS88092%27 HTTP/1.1" 200 None
2026-03-30 09:01:36 [auto1.it] INFO: Scrape type for DS88092: 2
2026-03-30 09:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c267fb17-ebe6-5222-b627-755d9b174cdf with identifier: DS88092
2026-03-30 09:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c267fb17-ebe6-5222-b627-755d9b174cdf with scrape type 2
2026-03-30 09:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c267fb17-ebe6-5222-b627-755d9b174cdf with scrape type 2
2026-03-30 09:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c267fb17-ebe6-5222-b627-755d9b174cdf, identifier: DS88092
2026-03-30 09:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR36455/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF04390/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA85498> (referer: https://www.auto1.com/v1/car-details-view/VA85498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_66c81dda243d5759fc56a61e42a4cf58.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_345767b1463b5d3c698f3458f19db69e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_85d95cb053da054e702d688cae8f2cad.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_ebc667751ad390c9639355647cd5161b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_e475a2ae8e15ef398b5ebd294283ed85.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c267fb17-ebe6-5222-b627-755d9b174cdf with identifier: DS88092
2026-03-30 09:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c267fb17-ebe6-5222-b627-755d9b174cdf with identifier: DS88092
2026-03-30 09:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c267fb17-ebe6-5222-b627-755d9b174cdf with identifier: DS88092 to the API
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:15:24Z',
 'fuel_type': 'diesel',
 'id': 'c267fb17-ebe6-5222-b627-755d9b174cdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS88092',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 87093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-30',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS88092%27 HTTP/1.1" 200 None
2026-03-30 09:01:36 [auto1.it] INFO: Saving data for DS88092: {'auction_closing_time': 1774970124.0, 'created_time': 1774386254.408336, 'last_price_update_time': 1774861296.960719}
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DS88092') HTTP/1.1" 204 0
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_6f7bcb22c0e3ea355f312fad31c54350.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_6f7bcb22c0e3ea355f312fad31c54350.jpg not downloaded yet
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_052b6800ad5e8ad40c781a23fed168e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_052b6800ad5e8ad40c781a23fed168e9.jpg not downloaded yet
2026-03-30 09:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38d07482-baa2-5808-84b2-574aeaf528f8 with identifier: JW12338
2026-03-30 09:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38d07482-baa2-5808-84b2-574aeaf528f8 with scrape type 1
2026-03-30 09:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 38d07482-baa2-5808-84b2-574aeaf528f8
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fe0%252F1be0724ac49dd34db52a7cc6ddd94eb6%252Fpa%252FJW12338_988e35f79581a033993e9219ccc08fad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_988e35f79581a033993e9219ccc08fad.jpg not downloaded yet
2026-03-30 09:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e41ad0>
2026-03-30 09:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_2f2fc80ef2207f848d0bace155cced7e.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_2f2fc80ef2207f848d0bace155cced7e.jpg saved to cache
2026-03-30 09:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f368433-1126-5740-99be-d188c6a84c18
2026-03-30 09:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 510c83d9-e47c-5814-bca5-1497ad9b5c8b with identifier: AP34592
2026-03-30 09:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 510c83d9-e47c-5814-bca5-1497ad9b5c8b with scrape type 1
2026-03-30 09:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 510c83d9-e47c-5814-bca5-1497ad9b5c8b
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F21%252F1421d785cbcee5d86727c955c4107683%252Fpa%252FAP34592_e367d0ce6192fa74cdfdf4f91989ef55.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_e367d0ce6192fa74cdfdf4f91989ef55.jpg not downloaded yet
2026-03-30 09:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_b9009952221f6f10e0ca5f348a9d8d80.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:37 [auto1.it] INFO: Found listing with ID: KC09537
2026-03-30 09:01:37 [auto1.it] INFO: Found listing with ID: KU76175
2026-03-30 09:01:37 [auto1.it] INFO: Found listing with ID: NY59521
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY59521%27 HTTP/1.1" 200 None
2026-03-30 09:01:37 [auto1.it] INFO: Scrape type for NY59521: 2
2026-03-30 09:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a19108a-6505-5cc2-8dd2-67df5259db83 with identifier: NY59521
2026-03-30 09:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a19108a-6505-5cc2-8dd2-67df5259db83 with scrape type 2
2026-03-30 09:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a19108a-6505-5cc2-8dd2-67df5259db83 with scrape type 2
2026-03-30 09:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a19108a-6505-5cc2-8dd2-67df5259db83, identifier: NY59521
2026-03-30 09:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a19108a-6505-5cc2-8dd2-67df5259db83 with identifier: NY59521
2026-03-30 09:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a19108a-6505-5cc2-8dd2-67df5259db83 with identifier: NY59521
2026-03-30 09:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a19108a-6505-5cc2-8dd2-67df5259db83 with identifier: NY59521 to the API
2026-03-30 09:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-31T15:48:05Z',
 'fuel_type': 'diesel',
 'id': '4a19108a-6505-5cc2-8dd2-67df5259db83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY59521',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 254538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-24',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Business Sport',
 'transmission': 'automatic',
 'trim': 'Business Sport',
 'year': 2016}
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY59521%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [auto1.it] INFO: Saving data for NY59521: {'auction_closing_time': 1774972085.0, 'created_time': 1774299808.599876, 'last_price_update_time': 1774861298.276737}
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NY59521') HTTP/1.1" 204 0
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_04d49824df348b05bec5c1c61140c5e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_04d49824df348b05bec5c1c61140c5e6.jpg not downloaded yet
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_7650eb80a6b576d5e73aeb3736b4baa8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_7650eb80a6b576d5e73aeb3736b4baa8.jpg not downloaded yet
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fe0%252F1be0724ac49dd34db52a7cc6ddd94eb6%252Fpa%252FJW12338_517d24e94300af42c6db42259ab7db6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_517d24e94300af42c6db42259ab7db6a.jpg not downloaded yet
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F21%252F1421d785cbcee5d86727c955c4107683%252Fpa%252FAP34592_4b0bb88991e18aa347091045b5918cd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_4b0bb88991e18aa347091045b5918cd5.jpg not downloaded yet
2026-03-30 09:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YX59353/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c7d812d-506f-5f49-bd27-064e7059e4b7 with identifier: VA85498
2026-03-30 09:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c7d812d-506f-5f49-bd27-064e7059e4b7 with scrape type 1
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c7d812d-506f-5f49-bd27-064e7059e4b7
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F5f%252F965f0ca0d49043f664dc6a188f87c393%252Fpa%252FVA85498_fe99937b6f2126f34afe8dd9617cd229.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_fe99937b6f2126f34afe8dd9617cd229.jpg already downloaded
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F5f%252F965f0ca0d49043f664dc6a188f87c393%252Fpa%252FVA85498_149ecf49db928bac89c0bf805a8c7da9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_149ecf49db928bac89c0bf805a8c7da9.jpg already downloaded
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F5f%252F965f0ca0d49043f664dc6a188f87c393%252Fpa%252FVA85498_a8a2bb737bfe5dbaad2bd671d649db89.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_a8a2bb737bfe5dbaad2bd671d649db89.jpg already downloaded
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F5f%252F965f0ca0d49043f664dc6a188f87c393%252Fpa%252FVA85498_7a25526496be447d6252b38718365796.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7a25526496be447d6252b38718365796.jpg already downloaded
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F5f%252F965f0ca0d49043f664dc6a188f87c393%252Fpa%252FVA85498_0a4262e6e046d71b5d6cf85e28d8a953.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_0a4262e6e046d71b5d6cf85e28d8a953.jpg already downloaded
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F5f%252F965f0ca0d49043f664dc6a188f87c393%252Fpa%252FVA85498_5d10d25a5e2926cafaa691ed86e1ecf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_5d10d25a5e2926cafaa691ed86e1ecf8.jpg already downloaded
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F5f%252F965f0ca0d49043f664dc6a188f87c393%252Fpa%252FVA85498_7bbb74cddc3cae73ea5455b18cf25041.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7bbb74cddc3cae73ea5455b18cf25041.jpg already downloaded
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F5f%252F965f0ca0d49043f664dc6a188f87c393%252Fpa%252FVA85498_082f915adf968a80fb96dc00f1a870c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_082f915adf968a80fb96dc00f1a870c9.jpg already downloaded
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F5f%252F965f0ca0d49043f664dc6a188f87c393%252Fpa%252FVA85498_e733dd5b60bed16c6a4bd16738811e64.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_e733dd5b60bed16c6a4bd16738811e64.jpg already downloaded
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F5f%252F965f0ca0d49043f664dc6a188f87c393%252Fpa%252FVA85498_c45b623f6a2b5fe3a8a2413e93fcb0a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_c45b623f6a2b5fe3a8a2413e93fcb0a5.jpg already downloaded
2026-03-30 09:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2c7d812d-506f-5f49-bd27-064e7059e4b7, identifier: VA85498
2026-03-30 09:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ed7690>
2026-03-30 09:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_66c81dda243d5759fc56a61e42a4cf58.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_66c81dda243d5759fc56a61e42a4cf58.jpg saved to cache
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b
2026-03-30 09:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e46690>
2026-03-30 09:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530d4275-298b-5e92-b175-74a3620a07f9/530d4275-298b-5e92-b175-74a3620a07f9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe9%252Fc4e96809ea176ae85a9f3d87f1a19eb0%252Fpa%252FCL10517_345767b1463b5d3c698f3458f19db69e.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_345767b1463b5d3c698f3458f19db69e.jpg saved to cache
2026-03-30 09:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 530d4275-298b-5e92-b175-74a3620a07f9
2026-03-30 09:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06203c90>
2026-03-30 09:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_85d95cb053da054e702d688cae8f2cad.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_85d95cb053da054e702d688cae8f2cad.jpg saved to cache
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a998de2d-1060-5046-bfb5-eaa4b85bacbb
2026-03-30 09:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061990d0>
2026-03-30 09:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_ebc667751ad390c9639355647cd5161b.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_ebc667751ad390c9639355647cd5161b.jpg saved to cache
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af38efeb-5cc6-51f7-90cf-d45670006072
2026-03-30 09:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cbe190>
2026-03-30 09:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_e475a2ae8e15ef398b5ebd294283ed85.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_e475a2ae8e15ef398b5ebd294283ed85.jpg saved to cache
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f368433-1126-5740-99be-d188c6a84c18
2026-03-30 09:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_789484c4496cfa3f8f4c001aaf365d9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_0ba88efd8c7ada1adaf29136af93bdf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_2bd06ed62f15ce979f85b6668030a041.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_1e457d621d077dc768ac6484bd3a9e88.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_1e457d621d077dc768ac6484bd3a9e88.jpg not downloaded yet
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_7459cf7a9d31c8c5e8dd847d8a62179d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_7459cf7a9d31c8c5e8dd847d8a62179d.jpg not downloaded yet
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fe0%252F1be0724ac49dd34db52a7cc6ddd94eb6%252Fpa%252FJW12338_90eff0a02d0e12337a56624e4422df67.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_90eff0a02d0e12337a56624e4422df67.jpg not downloaded yet
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F21%252F1421d785cbcee5d86727c955c4107683%252Fpa%252FAP34592_b612b33243ae44a8d8a60f3ecafc9fd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_b612b33243ae44a8d8a60f3ecafc9fd5.jpg not downloaded yet
2026-03-30 09:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2c7d812d-506f-5f49-bd27-064e7059e4b7 with identifier: VA85498
2026-03-30 09:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2c7d812d-506f-5f49-bd27-064e7059e4b7 with identifier: VA85498
2026-03-30 09:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2c7d812d-506f-5f49-bd27-064e7059e4b7 with identifier: VA85498 to the API
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VA85498>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:37:55Z',
 'fuel_type': 'diesel',
 'id': '2c7d812d-506f-5f49-bd27-064e7059e4b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA85498',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 143796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_fe99937b6f2126f34afe8dd9617cd229.jpg',
                'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_149ecf49db928bac89c0bf805a8c7da9.jpg',
                'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_a8a2bb737bfe5dbaad2bd671d649db89.jpg',
                'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7a25526496be447d6252b38718365796.jpg',
                'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_0a4262e6e046d71b5d6cf85e28d8a953.jpg',
                'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_5d10d25a5e2926cafaa691ed86e1ecf8.jpg',
                'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7bbb74cddc3cae73ea5455b18cf25041.jpg',
                'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_082f915adf968a80fb96dc00f1a870c9.jpg',
                'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_e733dd5b60bed16c6a4bd16738811e64.jpg',
                'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_c45b623f6a2b5fe3a8a2413e93fcb0a5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3432136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_fe99937b6f2126f34afe8dd9617cd229.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3225538,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_149ecf49db928bac89c0bf805a8c7da9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3378530,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_a8a2bb737bfe5dbaad2bd671d649db89.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3115210,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7a25526496be447d6252b38718365796.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_0a4262e6e046d71b5d6cf85e28d8a953.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_5d10d25a5e2926cafaa691ed86e1ecf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7bbb74cddc3cae73ea5455b18cf25041.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3781999,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_082f915adf968a80fb96dc00f1a870c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_e733dd5b60bed16c6a4bd16738811e64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_c45b623f6a2b5fe3a8a2413e93fcb0a5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTDM Progression',
 'transmission': 'manual',
 'trim': 'Progression',
 'year': 2013}
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA85498%27 HTTP/1.1" 200 None
2026-03-30 09:01:39 [auto1.it] INFO: Saving data for VA85498: {'created_time': 1774861299.793858, 'last_price_update_time': 1774861299.793872, 'auction_closing_time': 1774971475.0}
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VA85498') HTTP/1.1" 204 0
2026-03-30 09:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_148132731aab92c862f00314aeec6cd0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_18d168f588211ddc34cc75a2cc411864.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_2ab7ce252ac36903eb8faa24975439c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d84d90>
2026-03-30 09:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_b9009952221f6f10e0ca5f348a9d8d80.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_b9009952221f6f10e0ca5f348a9d8d80.jpg saved to cache
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af38efeb-5cc6-51f7-90cf-d45670006072
2026-03-30 09:01:39 [auto1.it] INFO: Channel: 24h | Page: 7 | totalHits: 3287 | hits on page: 40
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_e289dab750102906e1fde3fa1e5d33f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_e289dab750102906e1fde3fa1e5d33f0.jpg not downloaded yet
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_2646b7884b90cb456052cfa72f9513c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_2646b7884b90cb456052cfa72f9513c0.jpg not downloaded yet
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fe0%252F1be0724ac49dd34db52a7cc6ddd94eb6%252Fpa%252FJW12338_d5dc262b0a2f3de4fac0e3784f254e59.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_d5dc262b0a2f3de4fac0e3784f254e59.jpg not downloaded yet
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F21%252F1421d785cbcee5d86727c955c4107683%252Fpa%252FAP34592_c862f1a79e5c2923f5bf0aee844b539a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_c862f1a79e5c2923f5bf0aee844b539a.jpg not downloaded yet
2026-03-30 09:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD49777/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:39 [auto1.it] INFO: Found listing with ID: KU76175
2026-03-30 09:01:39 [auto1.it] INFO: Found listing with ID: NY59521
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY59521%27 HTTP/1.1" 200 None
2026-03-30 09:01:39 [auto1.it] INFO: Scrape type for NY59521: 0
2026-03-30 09:01:39 [auto1.it] INFO: Found listing with ID: ZT54121
2026-03-30 09:01:39 [auto1.it] INFO: Found listing with ID: HW13638
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW13638%27 HTTP/1.1" 200 None
2026-03-30 09:01:39 [auto1.it] INFO: Scrape type for HW13638: 2
2026-03-30 09:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05b058a7-93ce-505b-97a6-ad2635cb81ca with identifier: HW13638
2026-03-30 09:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05b058a7-93ce-505b-97a6-ad2635cb81ca with scrape type 2
2026-03-30 09:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05b058a7-93ce-505b-97a6-ad2635cb81ca with scrape type 2
2026-03-30 09:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 05b058a7-93ce-505b-97a6-ad2635cb81ca, identifier: HW13638
2026-03-30 09:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_bc6907aa1884cfb235e6b86d0e549e48.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_31c139fbe43ba533ec5b4faf44a41836.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_a45cc4bd951e373223d10d6cdc19ee0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_28094d1dab5296ea7d05583960019c78.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_28094d1dab5296ea7d05583960019c78.jpg not downloaded yet
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fe0%252F1be0724ac49dd34db52a7cc6ddd94eb6%252Fpa%252FJW12338_bc9303ec624a5cc85d9fd86266a58b7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_bc9303ec624a5cc85d9fd86266a58b7b.jpg not downloaded yet
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F21%252F1421d785cbcee5d86727c955c4107683%252Fpa%252FAP34592_8fb2a898c244f6602664bf8a864b46d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_8fb2a898c244f6602664bf8a864b46d2.jpg not downloaded yet
2026-03-30 09:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 05b058a7-93ce-505b-97a6-ad2635cb81ca with identifier: HW13638
2026-03-30 09:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 05b058a7-93ce-505b-97a6-ad2635cb81ca with identifier: HW13638
2026-03-30 09:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 05b058a7-93ce-505b-97a6-ad2635cb81ca with identifier: HW13638 to the API
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:33:29Z',
 'fuel_type': 'diesel',
 'id': '05b058a7-93ce-505b-97a6-ad2635cb81ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW13638',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 260969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-30',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2016}
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW13638%27 HTTP/1.1" 200 None
2026-03-30 09:01:40 [auto1.it] INFO: Saving data for HW13638: {'auction_closing_time': 1774971209.0, 'created_time': 1774343010.502002, 'last_price_update_time': 1774861300.588452}
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW13638') HTTP/1.1" 204 0
2026-03-30 09:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0cf2fdd0>
2026-03-30 09:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530d4275-298b-5e92-b175-74a3620a07f9/530d4275-298b-5e92-b175-74a3620a07f9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe9%252Fc4e96809ea176ae85a9f3d87f1a19eb0%252Fpa%252FCL10517_789484c4496cfa3f8f4c001aaf365d9d.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_789484c4496cfa3f8f4c001aaf365d9d.jpg saved to cache
2026-03-30 09:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 530d4275-298b-5e92-b175-74a3620a07f9
2026-03-30 09:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fc5710>
2026-03-30 09:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_0ba88efd8c7ada1adaf29136af93bdf3.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_0ba88efd8c7ada1adaf29136af93bdf3.jpg saved to cache
2026-03-30 09:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a998de2d-1060-5046-bfb5-eaa4b85bacbb
2026-03-30 09:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f63550>
2026-03-30 09:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_2bd06ed62f15ce979f85b6668030a041.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_2bd06ed62f15ce979f85b6668030a041.jpg saved to cache
2026-03-30 09:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af38efeb-5cc6-51f7-90cf-d45670006072
2026-03-30 09:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_673548e3ea75c4dae1c65e3406edd7f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_e367d0ce6192fa74cdfdf4f91989ef55.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_4b0bb88991e18aa347091045b5918cd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:40 [auto1.it] INFO: Found listing with ID: VP28061
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP28061%27 HTTP/1.1" 200 None
2026-03-30 09:01:40 [auto1.it] INFO: Scrape type for VP28061: 2
2026-03-30 09:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04b67f46-6068-5a5b-b8a4-2cc95673953e with identifier: VP28061
2026-03-30 09:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04b67f46-6068-5a5b-b8a4-2cc95673953e with scrape type 2
2026-03-30 09:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04b67f46-6068-5a5b-b8a4-2cc95673953e with scrape type 2
2026-03-30 09:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 04b67f46-6068-5a5b-b8a4-2cc95673953e, identifier: VP28061
2026-03-30 09:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_b75e5add0010340b0ddcc4e79f7179a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_4c692a255ecde6ff6dd00b28e55d7de3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_4c692a255ecde6ff6dd00b28e55d7de3.jpg not downloaded yet
2026-03-30 09:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 04b67f46-6068-5a5b-b8a4-2cc95673953e with identifier: VP28061
2026-03-30 09:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 04b67f46-6068-5a5b-b8a4-2cc95673953e with identifier: VP28061
2026-03-30 09:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 04b67f46-6068-5a5b-b8a4-2cc95673953e with identifier: VP28061 to the API
2026-03-30 09:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:55:22Z',
 'fuel_type': 'petrol',
 'id': '04b67f46-6068-5a5b-b8a4-2cc95673953e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP28061',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 83391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2021}
2026-03-30 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP28061%27 HTTP/1.1" 200 None
2026-03-30 09:01:41 [auto1.it] INFO: Saving data for VP28061: {'auction_closing_time': 1774972522.0, 'created_time': 1774386108.394055, 'last_price_update_time': 1774861301.781115}
2026-03-30 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VP28061') HTTP/1.1" 204 0
2026-03-30 09:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_bb1f2f7f7b6d8882fefda38f3154fc2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:41 [auto1.it] INFO: Found listing with ID: HP25104
2026-03-30 09:01:41 [auto1.it] INFO: Found listing with ID: FX22483
2026-03-30 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX22483%27 HTTP/1.1" 200 None
2026-03-30 09:01:41 [auto1.it] INFO: Scrape type for FX22483: 2
2026-03-30 09:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fab325cd-2ac4-596b-83a9-5de3aed7d440 with identifier: FX22483
2026-03-30 09:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fab325cd-2ac4-596b-83a9-5de3aed7d440 with scrape type 2
2026-03-30 09:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fab325cd-2ac4-596b-83a9-5de3aed7d440 with scrape type 2
2026-03-30 09:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fab325cd-2ac4-596b-83a9-5de3aed7d440, identifier: FX22483
2026-03-30 09:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d39ed0>
2026-03-30 09:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_148132731aab92c862f00314aeec6cd0.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_148132731aab92c862f00314aeec6cd0.jpg saved to cache
2026-03-30 09:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af38efeb-5cc6-51f7-90cf-d45670006072
2026-03-30 09:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d06c8d0>
2026-03-30 09:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_18d168f588211ddc34cc75a2cc411864.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_18d168f588211ddc34cc75a2cc411864.jpg saved to cache
2026-03-30 09:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a998de2d-1060-5046-bfb5-eaa4b85bacbb
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06245610>
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_2ab7ce252ac36903eb8faa24975439c8.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_2ab7ce252ac36903eb8faa24975439c8.jpg saved to cache
2026-03-30 09:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a998de2d-1060-5046-bfb5-eaa4b85bacbb
2026-03-30 09:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0613b750>
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_bc6907aa1884cfb235e6b86d0e549e48.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_bc6907aa1884cfb235e6b86d0e549e48.jpg saved to cache
2026-03-30 09:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0622fbd0>
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530d4275-298b-5e92-b175-74a3620a07f9/530d4275-298b-5e92-b175-74a3620a07f9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe9%252Fc4e96809ea176ae85a9f3d87f1a19eb0%252Fpa%252FCL10517_31c139fbe43ba533ec5b4faf44a41836.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_31c139fbe43ba533ec5b4faf44a41836.jpg saved to cache
2026-03-30 09:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 530d4275-298b-5e92-b175-74a3620a07f9
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06244c50>
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F7a%252F6d7aa725596014f830a4418cbeca2128%252Fpa%252FGM45638_a45cc4bd951e373223d10d6cdc19ee0e.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_a45cc4bd951e373223d10d6cdc19ee0e.jpg saved to cache
2026-03-30 09:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f368433-1126-5740-99be-d188c6a84c18
2026-03-30 09:01:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f368433-1126-5740-99be-d188c6a84c18, skipping ID generation
2026-03-30 09:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f368433-1126-5740-99be-d188c6a84c18 with scrape type 1
2026-03-30 09:01:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f368433-1126-5740-99be-d188c6a84c18 sending to next pipeline
2026-03-30 09:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3f368433-1126-5740-99be-d188c6a84c18, identifier: GM45638
2026-03-30 09:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_c862f1a79e5c2923f5bf0aee844b539a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_d5dc262b0a2f3de4fac0e3784f254e59.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_04d49824df348b05bec5c1c61140c5e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_7650eb80a6b576d5e73aeb3736b4baa8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fab325cd-2ac4-596b-83a9-5de3aed7d440 with identifier: FX22483
2026-03-30 09:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fab325cd-2ac4-596b-83a9-5de3aed7d440 with identifier: FX22483
2026-03-30 09:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fab325cd-2ac4-596b-83a9-5de3aed7d440 with identifier: FX22483 to the API
2026-03-30 09:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:58:58Z',
 'fuel_type': 'petrol',
 'id': 'fab325cd-2ac4-596b-83a9-5de3aed7d440',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX22483',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 83743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-16',
 'seller_name': None,
 'title': 'Audi Q3 35 TFSI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2019}
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX22483%27 HTTP/1.1" 200 None
2026-03-30 09:01:43 [auto1.it] INFO: Saving data for FX22483: {'auction_closing_time': 1774972738.0, 'created_time': 1772705333.285162, 'last_price_update_time': 1774861303.213771}
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FX22483') HTTP/1.1" 204 0
2026-03-30 09:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3f368433-1126-5740-99be-d188c6a84c18 with identifier: GM45638
2026-03-30 09:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3f368433-1126-5740-99be-d188c6a84c18 with identifier: GM45638
2026-03-30 09:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3f368433-1126-5740-99be-d188c6a84c18 with identifier: GM45638 to the API
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_a45cc4bd951e373223d10d6cdc19ee0e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 178,
 'expiration_date': '2026-03-31T15:10:44Z',
 'fuel_type': 'petrol',
 'id': '3f368433-1126-5740-99be-d188c6a84c18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM45638',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 104665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_dea0505fc2c24ffddf9d26ac30bd22c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_44fd678c8fa4ab3807103cba6be65d39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_2f45b53274816250cc29a2ae8fe041db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_dfad3cc1e0677ee699c15e27103c201c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_f96afb63991fe7c7e104a71a16be19f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_9c6ea5f39b558bd3b102d701e45ee124.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_a7d93b0814fa951ef803ee5eff21325c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_2f2fc80ef2207f848d0bace155cced7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_a45cc4bd951e373223d10d6cdc19ee0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f368433-1126-5740-99be-d188c6a84c18/3f368433-1126-5740-99be-d188c6a84c18_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/7a/6d7aa725596014f830a4418cbeca2128/pa/GM45638_e475a2ae8e15ef398b5ebd294283ed85.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S Essential Trim',
 'transmission': 'automatic',
 'trim': 'Essential Trim',
 'year': 2021}
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM45638%27 HTTP/1.1" 200 None
2026-03-30 09:01:43 [auto1.it] INFO: Saving data for GM45638: {'created_time': 1774861303.723831, 'last_price_update_time': 1774861303.723841, 'auction_closing_time': 1774969844.0}
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GM45638') HTTP/1.1" 204 0
2026-03-30 09:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_988e35f79581a033993e9219ccc08fad.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_517d24e94300af42c6db42259ab7db6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:43 [auto1.it] INFO: Found listing with ID: VW75885
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW75885%27 HTTP/1.1" 200 None
2026-03-30 09:01:43 [auto1.it] INFO: Scrape type for VW75885: 2
2026-03-30 09:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f03a8064-e289-5430-a118-deab27c5f9b0 with identifier: VW75885
2026-03-30 09:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f03a8064-e289-5430-a118-deab27c5f9b0 with scrape type 2
2026-03-30 09:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f03a8064-e289-5430-a118-deab27c5f9b0 with scrape type 2
2026-03-30 09:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f03a8064-e289-5430-a118-deab27c5f9b0, identifier: VW75885
2026-03-30 09:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0617fc90>
2026-03-30 09:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530d4275-298b-5e92-b175-74a3620a07f9/530d4275-298b-5e92-b175-74a3620a07f9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe9%252Fc4e96809ea176ae85a9f3d87f1a19eb0%252Fpa%252FCL10517_673548e3ea75c4dae1c65e3406edd7f0.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_673548e3ea75c4dae1c65e3406edd7f0.jpg saved to cache
2026-03-30 09:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 530d4275-298b-5e92-b175-74a3620a07f9
2026-03-30 09:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 530d4275-298b-5e92-b175-74a3620a07f9, skipping ID generation
2026-03-30 09:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 530d4275-298b-5e92-b175-74a3620a07f9 with scrape type 1
2026-03-30 09:01:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 530d4275-298b-5e92-b175-74a3620a07f9 sending to next pipeline
2026-03-30 09:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 530d4275-298b-5e92-b175-74a3620a07f9, identifier: CL10517
2026-03-30 09:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0616b550>
2026-03-30 09:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510c83d9-e47c-5814-bca5-1497ad9b5c8b/510c83d9-e47c-5814-bca5-1497ad9b5c8b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F21%252F1421d785cbcee5d86727c955c4107683%252Fpa%252FAP34592_e367d0ce6192fa74cdfdf4f91989ef55.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_e367d0ce6192fa74cdfdf4f91989ef55.jpg saved to cache
2026-03-30 09:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 510c83d9-e47c-5814-bca5-1497ad9b5c8b
2026-03-30 09:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0619a6d0>
2026-03-30 09:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510c83d9-e47c-5814-bca5-1497ad9b5c8b/510c83d9-e47c-5814-bca5-1497ad9b5c8b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F21%252F1421d785cbcee5d86727c955c4107683%252Fpa%252FAP34592_4b0bb88991e18aa347091045b5918cd5.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_4b0bb88991e18aa347091045b5918cd5.jpg saved to cache
2026-03-30 09:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 510c83d9-e47c-5814-bca5-1497ad9b5c8b
2026-03-30 09:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c03250>
2026-03-30 09:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_b75e5add0010340b0ddcc4e79f7179a2.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_b75e5add0010340b0ddcc4e79f7179a2.jpg saved to cache
2026-03-30 09:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a998de2d-1060-5046-bfb5-eaa4b85bacbb
2026-03-30 09:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_e289dab750102906e1fde3fa1e5d33f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f03a8064-e289-5430-a118-deab27c5f9b0 with identifier: VW75885
2026-03-30 09:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f03a8064-e289-5430-a118-deab27c5f9b0 with identifier: VW75885
2026-03-30 09:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f03a8064-e289-5430-a118-deab27c5f9b0 with identifier: VW75885 to the API
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:23:28Z',
 'fuel_type': 'diesel',
 'id': 'f03a8064-e289-5430-a118-deab27c5f9b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW75885',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 149397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-31',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2012}
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW75885%27 HTTP/1.1" 200 None
2026-03-30 09:01:44 [auto1.it] INFO: Saving data for VW75885: {'auction_closing_time': 1774970608.0, 'created_time': 1774472770.802683, 'last_price_update_time': 1774861304.587713}
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VW75885') HTTP/1.1" 204 0
2026-03-30 09:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 530d4275-298b-5e92-b175-74a3620a07f9 with identifier: CL10517
2026-03-30 09:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 530d4275-298b-5e92-b175-74a3620a07f9 with identifier: CL10517
2026-03-30 09:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 530d4275-298b-5e92-b175-74a3620a07f9 with identifier: CL10517 to the API
2026-03-30 09:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_673548e3ea75c4dae1c65e3406edd7f0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 77,
 'expiration_date': '2026-03-31T15:23:05Z',
 'fuel_type': 'petrol',
 'id': '530d4275-298b-5e92-b175-74a3620a07f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL10517',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 194704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530d4275-298b-5e92-b175-74a3620a07f9/530d4275-298b-5e92-b175-74a3620a07f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_a44c6013182a1ecc26a38bc6c574e59e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530d4275-298b-5e92-b175-74a3620a07f9/530d4275-298b-5e92-b175-74a3620a07f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_673548e3ea75c4dae1c65e3406edd7f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530d4275-298b-5e92-b175-74a3620a07f9/530d4275-298b-5e92-b175-74a3620a07f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_345767b1463b5d3c698f3458f19db69e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530d4275-298b-5e92-b175-74a3620a07f9/530d4275-298b-5e92-b175-74a3620a07f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_31c139fbe43ba533ec5b4faf44a41836.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530d4275-298b-5e92-b175-74a3620a07f9/530d4275-298b-5e92-b175-74a3620a07f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/e9/c4e96809ea176ae85a9f3d87f1a19eb0/pa/CL10517_789484c4496cfa3f8f4c001aaf365d9d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-10-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2007}
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL10517%27 HTTP/1.1" 200 None
2026-03-30 09:01:45 [auto1.it] INFO: Saving data for CL10517: {'created_time': 1774861305.18135, 'last_price_update_time': 1774861305.181363, 'auction_closing_time': 1774970585.0}
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CL10517') HTTP/1.1" 204 0
2026-03-30 09:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0622ad90>
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_bb1f2f7f7b6d8882fefda38f3154fc2d.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_bb1f2f7f7b6d8882fefda38f3154fc2d.jpg saved to cache
2026-03-30 09:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b
2026-03-30 09:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_2646b7884b90cb456052cfa72f9513c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:45 [auto1.it] INFO: Found listing with ID: ZB56283
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB56283%27 HTTP/1.1" 200 None
2026-03-30 09:01:45 [auto1.it] INFO: Scrape type for ZB56283: 2
2026-03-30 09:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8525a47-5563-58a6-ac65-30baeb8ff606 with identifier: ZB56283
2026-03-30 09:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8525a47-5563-58a6-ac65-30baeb8ff606 with scrape type 2
2026-03-30 09:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8525a47-5563-58a6-ac65-30baeb8ff606 with scrape type 2
2026-03-30 09:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8525a47-5563-58a6-ac65-30baeb8ff606, identifier: ZB56283
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d42150>
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510c83d9-e47c-5814-bca5-1497ad9b5c8b/510c83d9-e47c-5814-bca5-1497ad9b5c8b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F21%252F1421d785cbcee5d86727c955c4107683%252Fpa%252FAP34592_c862f1a79e5c2923f5bf0aee844b539a.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_c862f1a79e5c2923f5bf0aee844b539a.jpg saved to cache
2026-03-30 09:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 510c83d9-e47c-5814-bca5-1497ad9b5c8b
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06200b90>
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d07482-baa2-5808-84b2-574aeaf528f8/38d07482-baa2-5808-84b2-574aeaf528f8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fe0%252F1be0724ac49dd34db52a7cc6ddd94eb6%252Fpa%252FJW12338_d5dc262b0a2f3de4fac0e3784f254e59.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_d5dc262b0a2f3de4fac0e3784f254e59.jpg saved to cache
2026-03-30 09:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38d07482-baa2-5808-84b2-574aeaf528f8
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0636ac90>
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_04d49824df348b05bec5c1c61140c5e6.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_04d49824df348b05bec5c1c61140c5e6.jpg saved to cache
2026-03-30 09:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a998de2d-1060-5046-bfb5-eaa4b85bacbb
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ce29d0>
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_7650eb80a6b576d5e73aeb3736b4baa8.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_7650eb80a6b576d5e73aeb3736b4baa8.jpg saved to cache
2026-03-30 09:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af38efeb-5cc6-51f7-90cf-d45670006072
2026-03-30 09:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_b612b33243ae44a8d8a60f3ecafc9fd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8525a47-5563-58a6-ac65-30baeb8ff606 with identifier: ZB56283
2026-03-30 09:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8525a47-5563-58a6-ac65-30baeb8ff606 with identifier: ZB56283
2026-03-30 09:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8525a47-5563-58a6-ac65-30baeb8ff606 with identifier: ZB56283 to the API
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:58:26Z',
 'fuel_type': 'diesel',
 'id': 'd8525a47-5563-58a6-ac65-30baeb8ff606',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB56283',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 95836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 e-HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB56283%27 HTTP/1.1" 200 None
2026-03-30 09:01:46 [auto1.it] INFO: Saving data for ZB56283: {'auction_closing_time': 1774972706.0, 'created_time': 1773851812.756178, 'last_price_update_time': 1774861306.080901}
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZB56283') HTTP/1.1" 204 0
2026-03-30 09:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062fbe50>
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d07482-baa2-5808-84b2-574aeaf528f8/38d07482-baa2-5808-84b2-574aeaf528f8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fe0%252F1be0724ac49dd34db52a7cc6ddd94eb6%252Fpa%252FJW12338_988e35f79581a033993e9219ccc08fad.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_988e35f79581a033993e9219ccc08fad.jpg saved to cache
2026-03-30 09:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38d07482-baa2-5808-84b2-574aeaf528f8
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c93190>
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d07482-baa2-5808-84b2-574aeaf528f8/38d07482-baa2-5808-84b2-574aeaf528f8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fe0%252F1be0724ac49dd34db52a7cc6ddd94eb6%252Fpa%252FJW12338_517d24e94300af42c6db42259ab7db6a.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_517d24e94300af42c6db42259ab7db6a.jpg saved to cache
2026-03-30 09:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38d07482-baa2-5808-84b2-574aeaf528f8
2026-03-30 09:01:46 [auto1.it] INFO: Found listing with ID: PY44760
2026-03-30 09:01:46 [auto1.it] INFO: Found listing with ID: ZD91383
2026-03-30 09:01:46 [auto1.it] INFO: Found listing with ID: UY37095
2026-03-30 09:01:46 [auto1.it] INFO: Found listing with ID: GY68527
2026-03-30 09:01:46 [auto1.it] INFO: Found listing with ID: SY55940
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY55940%27 HTTP/1.1" 200 None
2026-03-30 09:01:46 [auto1.it] INFO: Scrape type for SY55940: 2
2026-03-30 09:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dda7e232-c7b0-5239-b0d9-af5bb61077df with identifier: SY55940
2026-03-30 09:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dda7e232-c7b0-5239-b0d9-af5bb61077df with scrape type 2
2026-03-30 09:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dda7e232-c7b0-5239-b0d9-af5bb61077df with scrape type 2
2026-03-30 09:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dda7e232-c7b0-5239-b0d9-af5bb61077df, identifier: SY55940
2026-03-30 09:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR36455> (referer: https://www.auto1.com/v1/car-details-view/XR36455/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061a9950>
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_e289dab750102906e1fde3fa1e5d33f0.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_e289dab750102906e1fde3fa1e5d33f0.jpg saved to cache
2026-03-30 09:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a998de2d-1060-5046-bfb5-eaa4b85bacbb
2026-03-30 09:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_8fb2a898c244f6602664bf8a864b46d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_7459cf7a9d31c8c5e8dd847d8a62179d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dda7e232-c7b0-5239-b0d9-af5bb61077df with identifier: SY55940
2026-03-30 09:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dda7e232-c7b0-5239-b0d9-af5bb61077df with identifier: SY55940
2026-03-30 09:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dda7e232-c7b0-5239-b0d9-af5bb61077df with identifier: SY55940 to the API
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-31T15:36:59Z',
 'fuel_type': 'petrol',
 'id': 'dda7e232-c7b0-5239-b0d9-af5bb61077df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY55940',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 22254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-17',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Top',
 'transmission': 'manual',
 'trim': 'Top',
 'year': 2024}
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY55940%27 HTTP/1.1" 200 None
2026-03-30 09:01:46 [auto1.it] INFO: Saving data for SY55940: {'auction_closing_time': 1774971419.0, 'created_time': 1773267526.33167, 'last_price_update_time': 1774861306.781931}
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SY55940') HTTP/1.1" 204 0
2026-03-30 09:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YX59353> (referer: https://www.auto1.com/v1/car-details-view/YX59353/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK19595> (referer: https://www.auto1.com/v1/car-details-view/CK19595/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0638a810>
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_2646b7884b90cb456052cfa72f9513c0.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_2646b7884b90cb456052cfa72f9513c0.jpg saved to cache
2026-03-30 09:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af38efeb-5cc6-51f7-90cf-d45670006072
2026-03-30 09:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_28094d1dab5296ea7d05583960019c78.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_90eff0a02d0e12337a56624e4422df67.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_4c692a255ecde6ff6dd00b28e55d7de3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_1e457d621d077dc768ac6484bd3a9e88.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_bc9303ec624a5cc85d9fd86266a58b7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:46 [auto1.it] INFO: Found listing with ID: ES04012
2026-03-30 09:01:46 [auto1.it] INFO: Found listing with ID: YK56738
2026-03-30 09:01:46 [auto1.it] INFO: Found listing with ID: UM22430
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM22430%27 HTTP/1.1" 200 None
2026-03-30 09:01:46 [auto1.it] INFO: Scrape type for UM22430: 2
2026-03-30 09:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d70cccca-2a3c-507b-a23e-1d4994cb353c with identifier: UM22430
2026-03-30 09:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d70cccca-2a3c-507b-a23e-1d4994cb353c with scrape type 2
2026-03-30 09:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d70cccca-2a3c-507b-a23e-1d4994cb353c with scrape type 2
2026-03-30 09:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d70cccca-2a3c-507b-a23e-1d4994cb353c, identifier: UM22430
2026-03-30 09:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF04390> (referer: https://www.auto1.com/v1/car-details-view/PF04390/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06201010>
2026-03-30 09:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510c83d9-e47c-5814-bca5-1497ad9b5c8b/510c83d9-e47c-5814-bca5-1497ad9b5c8b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F21%252F1421d785cbcee5d86727c955c4107683%252Fpa%252FAP34592_b612b33243ae44a8d8a60f3ecafc9fd5.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_b612b33243ae44a8d8a60f3ecafc9fd5.jpg saved to cache
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 510c83d9-e47c-5814-bca5-1497ad9b5c8b
2026-03-30 09:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_052b6800ad5e8ad40c781a23fed168e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d70cccca-2a3c-507b-a23e-1d4994cb353c with identifier: UM22430
2026-03-30 09:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d70cccca-2a3c-507b-a23e-1d4994cb353c with identifier: UM22430
2026-03-30 09:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d70cccca-2a3c-507b-a23e-1d4994cb353c with identifier: UM22430 to the API
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:59:37Z',
 'fuel_type': 'diesel',
 'id': 'd70cccca-2a3c-507b-a23e-1d4994cb353c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM22430',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 67051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-23',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid 320 L1 Tourneo Titanium X',
 'transmission': 'manual',
 'trim': '320 L1 Tourneo Titanium X',
 'year': 2020}
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM22430%27 HTTP/1.1" 200 None
2026-03-30 09:01:47 [auto1.it] INFO: Saving data for UM22430: {'auction_closing_time': 1774972777.0, 'created_time': 1774447256.376586, 'last_price_update_time': 1774861307.394536}
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UM22430') HTTP/1.1" 204 0
2026-03-30 09:01:47 [auto1.it] INFO: Found listing with ID: HF31411
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF31411%27 HTTP/1.1" 200 None
2026-03-30 09:01:47 [auto1.it] INFO: Scrape type for HF31411: 2
2026-03-30 09:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c15951d-1176-5508-a164-3551f08c8f38 with identifier: HF31411
2026-03-30 09:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c15951d-1176-5508-a164-3551f08c8f38 with scrape type 2
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c15951d-1176-5508-a164-3551f08c8f38 with scrape type 2
2026-03-30 09:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c15951d-1176-5508-a164-3551f08c8f38, identifier: HF31411
2026-03-30 09:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ac2e81d-7dcd-5965-ad8b-89b989302b0d with identifier: XR36455
2026-03-30 09:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ac2e81d-7dcd-5965-ad8b-89b989302b0d with scrape type 1
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ac2e81d-7dcd-5965-ad8b-89b989302b0d
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F8a%252Fe98a0d6186df891282541e5edfc15e26%252Fpa%252FXR36455_4fad16ea495b2a7997fdd818254d5fec.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_4fad16ea495b2a7997fdd818254d5fec.jpg already downloaded
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F8a%252Fe98a0d6186df891282541e5edfc15e26%252Fpa%252FXR36455_0fb3689a935d41f51a1016f0b88af6ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_0fb3689a935d41f51a1016f0b88af6ac.jpg already downloaded
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F8a%252Fe98a0d6186df891282541e5edfc15e26%252Fpa%252FXR36455_5aab8759bdfea451082c0fa5964f0a9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_5aab8759bdfea451082c0fa5964f0a9c.jpg already downloaded
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F8a%252Fe98a0d6186df891282541e5edfc15e26%252Fpa%252FXR36455_93b0dfde7d694edbb3882a3ac4caa448.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_93b0dfde7d694edbb3882a3ac4caa448.jpg already downloaded
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F8a%252Fe98a0d6186df891282541e5edfc15e26%252Fpa%252FXR36455_d4a5829fbaf199ef5872e00b2b228b08.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_d4a5829fbaf199ef5872e00b2b228b08.jpg already downloaded
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F8a%252Fe98a0d6186df891282541e5edfc15e26%252Fpa%252FXR36455_a56fb8fc718b42a9f7f158e78d7b23c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_a56fb8fc718b42a9f7f158e78d7b23c1.jpg already downloaded
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F8a%252Fe98a0d6186df891282541e5edfc15e26%252Fpa%252FXR36455_2c28724da86883197ec46607cae4917e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_2c28724da86883197ec46607cae4917e.jpg already downloaded
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F8a%252Fe98a0d6186df891282541e5edfc15e26%252Fpa%252FXR36455_182f57e85ece7ffe2d910e5b665ad068.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_182f57e85ece7ffe2d910e5b665ad068.jpg already downloaded
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F8a%252Fe98a0d6186df891282541e5edfc15e26%252Fpa%252FXR36455_6e8aa86bc1edb34440d82a17fbbd6dd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_6e8aa86bc1edb34440d82a17fbbd6dd6.jpg already downloaded
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F8a%252Fe98a0d6186df891282541e5edfc15e26%252Fpa%252FXR36455_f30b2143cd06fa87540a019de7ab43ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_f30b2143cd06fa87540a019de7ab43ba.jpg already downloaded
2026-03-30 09:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ac2e81d-7dcd-5965-ad8b-89b989302b0d, identifier: XR36455
2026-03-30 09:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062cf010>
2026-03-30 09:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510c83d9-e47c-5814-bca5-1497ad9b5c8b/510c83d9-e47c-5814-bca5-1497ad9b5c8b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F21%252F1421d785cbcee5d86727c955c4107683%252Fpa%252FAP34592_8fb2a898c244f6602664bf8a864b46d2.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_8fb2a898c244f6602664bf8a864b46d2.jpg saved to cache
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 510c83d9-e47c-5814-bca5-1497ad9b5c8b
2026-03-30 09:01:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 510c83d9-e47c-5814-bca5-1497ad9b5c8b, skipping ID generation
2026-03-30 09:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 510c83d9-e47c-5814-bca5-1497ad9b5c8b with scrape type 1
2026-03-30 09:01:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 510c83d9-e47c-5814-bca5-1497ad9b5c8b sending to next pipeline
2026-03-30 09:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 510c83d9-e47c-5814-bca5-1497ad9b5c8b, identifier: AP34592
2026-03-30 09:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f4b710>
2026-03-30 09:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_7459cf7a9d31c8c5e8dd847d8a62179d.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_7459cf7a9d31c8c5e8dd847d8a62179d.jpg saved to cache
2026-03-30 09:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af38efeb-5cc6-51f7-90cf-d45670006072
2026-03-30 09:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_c01ebb94cc525016ac45b5c97a36e24d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_623347e62676787c752f7b01a41f4f7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_6f7bcb22c0e3ea355f312fad31c54350.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c15951d-1176-5508-a164-3551f08c8f38 with identifier: HF31411
2026-03-30 09:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c15951d-1176-5508-a164-3551f08c8f38 with identifier: HF31411
2026-03-30 09:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c15951d-1176-5508-a164-3551f08c8f38 with identifier: HF31411 to the API
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:00:48Z',
 'fuel_type': 'diesel',
 'id': '8c15951d-1176-5508-a164-3551f08c8f38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF31411',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 182540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-28',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi Style 2WD',
 'transmission': 'manual',
 'trim': 'Style 2WD',
 'year': 2012}
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF31411%27 HTTP/1.1" 200 None
2026-03-30 09:01:48 [auto1.it] INFO: Saving data for HF31411: {'auction_closing_time': 1774969248.0, 'created_time': 1774353659.886435, 'last_price_update_time': 1774861308.499065}
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HF31411') HTTP/1.1" 204 0
2026-03-30 09:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ac2e81d-7dcd-5965-ad8b-89b989302b0d with identifier: XR36455
2026-03-30 09:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ac2e81d-7dcd-5965-ad8b-89b989302b0d with identifier: XR36455
2026-03-30 09:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5ac2e81d-7dcd-5965-ad8b-89b989302b0d with identifier: XR36455 to the API
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XR36455>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:06:07Z',
 'fuel_type': 'diesel',
 'id': '5ac2e81d-7dcd-5965-ad8b-89b989302b0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR36455',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 105286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_4fad16ea495b2a7997fdd818254d5fec.jpg',
                'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_0fb3689a935d41f51a1016f0b88af6ac.jpg',
                'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_5aab8759bdfea451082c0fa5964f0a9c.jpg',
                'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_93b0dfde7d694edbb3882a3ac4caa448.jpg',
                'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_d4a5829fbaf199ef5872e00b2b228b08.jpg',
                'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_a56fb8fc718b42a9f7f158e78d7b23c1.jpg',
                'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_2c28724da86883197ec46607cae4917e.jpg',
                'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_182f57e85ece7ffe2d910e5b665ad068.jpg',
                'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_6e8aa86bc1edb34440d82a17fbbd6dd6.jpg',
                'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_f30b2143cd06fa87540a019de7ab43ba.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac2e81d-7dcd-5965-ad8b-89b989302b0d/5ac2e81d-7dcd-5965-ad8b-89b989302b0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2016282,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_4fad16ea495b2a7997fdd818254d5fec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac2e81d-7dcd-5965-ad8b-89b989302b0d/5ac2e81d-7dcd-5965-ad8b-89b989302b0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1816564,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_0fb3689a935d41f51a1016f0b88af6ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac2e81d-7dcd-5965-ad8b-89b989302b0d/5ac2e81d-7dcd-5965-ad8b-89b989302b0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_5aab8759bdfea451082c0fa5964f0a9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac2e81d-7dcd-5965-ad8b-89b989302b0d/5ac2e81d-7dcd-5965-ad8b-89b989302b0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_93b0dfde7d694edbb3882a3ac4caa448.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac2e81d-7dcd-5965-ad8b-89b989302b0d/5ac2e81d-7dcd-5965-ad8b-89b989302b0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2033250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_d4a5829fbaf199ef5872e00b2b228b08.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac2e81d-7dcd-5965-ad8b-89b989302b0d/5ac2e81d-7dcd-5965-ad8b-89b989302b0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_a56fb8fc718b42a9f7f158e78d7b23c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac2e81d-7dcd-5965-ad8b-89b989302b0d/5ac2e81d-7dcd-5965-ad8b-89b989302b0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2405701,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_2c28724da86883197ec46607cae4917e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac2e81d-7dcd-5965-ad8b-89b989302b0d/5ac2e81d-7dcd-5965-ad8b-89b989302b0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2282672,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_182f57e85ece7ffe2d910e5b665ad068.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac2e81d-7dcd-5965-ad8b-89b989302b0d/5ac2e81d-7dcd-5965-ad8b-89b989302b0d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2033872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_6e8aa86bc1edb34440d82a17fbbd6dd6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac2e81d-7dcd-5965-ad8b-89b989302b0d/5ac2e81d-7dcd-5965-ad8b-89b989302b0d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2258959,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/8a/e98a0d6186df891282541e5edfc15e26/pa/XR36455_f30b2143cd06fa87540a019de7ab43ba.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR36455%27 HTTP/1.1" 200 None
2026-03-30 09:01:48 [auto1.it] INFO: Saving data for XR36455: {'created_time': 1774861308.869215, 'last_price_update_time': 1774861308.869226, 'auction_closing_time': 1774969567.0}
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XR36455') HTTP/1.1" 204 0
2026-03-30 09:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 510c83d9-e47c-5814-bca5-1497ad9b5c8b with identifier: AP34592
2026-03-30 09:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 510c83d9-e47c-5814-bca5-1497ad9b5c8b with identifier: AP34592
2026-03-30 09:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 510c83d9-e47c-5814-bca5-1497ad9b5c8b with identifier: AP34592 to the API
2026-03-30 09:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_8fb2a898c244f6602664bf8a864b46d2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:47:02Z',
 'fuel_type': 'petrol',
 'id': '510c83d9-e47c-5814-bca5-1497ad9b5c8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP34592',
 'listing': 'auction',
 'location': 'IT, Gadesco-Pieve Delmona',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 155150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510c83d9-e47c-5814-bca5-1497ad9b5c8b/510c83d9-e47c-5814-bca5-1497ad9b5c8b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_e367d0ce6192fa74cdfdf4f91989ef55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510c83d9-e47c-5814-bca5-1497ad9b5c8b/510c83d9-e47c-5814-bca5-1497ad9b5c8b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_4b0bb88991e18aa347091045b5918cd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510c83d9-e47c-5814-bca5-1497ad9b5c8b/510c83d9-e47c-5814-bca5-1497ad9b5c8b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_b612b33243ae44a8d8a60f3ecafc9fd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510c83d9-e47c-5814-bca5-1497ad9b5c8b/510c83d9-e47c-5814-bca5-1497ad9b5c8b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_c862f1a79e5c2923f5bf0aee844b539a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510c83d9-e47c-5814-bca5-1497ad9b5c8b/510c83d9-e47c-5814-bca5-1497ad9b5c8b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/21/1421d785cbcee5d86727c955c4107683/pa/AP34592_8fb2a898c244f6602664bf8a864b46d2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.6 Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2010}
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP34592%27 HTTP/1.1" 200 None
2026-03-30 09:01:49 [auto1.it] INFO: Saving data for AP34592: {'created_time': 1774861309.868482, 'last_price_update_time': 1774861309.868494, 'auction_closing_time': 1774972022.0}
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AP34592') HTTP/1.1" 204 0
2026-03-30 09:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cde1fe2-2e56-5f10-bb1f-e13e714ec205 with identifier: YX59353
2026-03-30 09:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205 with scrape type 1
2026-03-30 09:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_82edf39051b52198e5db5a9c089f9ed0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_82edf39051b52198e5db5a9c089f9ed0.jpg not downloaded yet
2026-03-30 09:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1f7cbab-ab66-5b48-9635-a2dabcb7922d with identifier: CK19595
2026-03-30 09:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d with scrape type 1
2026-03-30 09:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_e6b0f93a990b7562c0c4f768d4d29543.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_e6b0f93a990b7562c0c4f768d4d29543.jpg not downloaded yet
2026-03-30 09:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d4a850>
2026-03-30 09:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_28094d1dab5296ea7d05583960019c78.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_28094d1dab5296ea7d05583960019c78.jpg saved to cache
2026-03-30 09:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af38efeb-5cc6-51f7-90cf-d45670006072
2026-03-30 09:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d9c450>
2026-03-30 09:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d07482-baa2-5808-84b2-574aeaf528f8/38d07482-baa2-5808-84b2-574aeaf528f8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fe0%252F1be0724ac49dd34db52a7cc6ddd94eb6%252Fpa%252FJW12338_90eff0a02d0e12337a56624e4422df67.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_90eff0a02d0e12337a56624e4422df67.jpg saved to cache
2026-03-30 09:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38d07482-baa2-5808-84b2-574aeaf528f8
2026-03-30 09:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063bcc90>
2026-03-30 09:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_4c692a255ecde6ff6dd00b28e55d7de3.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_4c692a255ecde6ff6dd00b28e55d7de3.jpg saved to cache
2026-03-30 09:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af38efeb-5cc6-51f7-90cf-d45670006072
2026-03-30 09:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e44750>
2026-03-30 09:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_1e457d621d077dc768ac6484bd3a9e88.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_1e457d621d077dc768ac6484bd3a9e88.jpg saved to cache
2026-03-30 09:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a998de2d-1060-5046-bfb5-eaa4b85bacbb
2026-03-30 09:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d9c2d0>
2026-03-30 09:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d07482-baa2-5808-84b2-574aeaf528f8/38d07482-baa2-5808-84b2-574aeaf528f8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fe0%252F1be0724ac49dd34db52a7cc6ddd94eb6%252Fpa%252FJW12338_bc9303ec624a5cc85d9fd86266a58b7b.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_bc9303ec624a5cc85d9fd86266a58b7b.jpg saved to cache
2026-03-30 09:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38d07482-baa2-5808-84b2-574aeaf528f8
2026-03-30 09:01:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38d07482-baa2-5808-84b2-574aeaf528f8, skipping ID generation
2026-03-30 09:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38d07482-baa2-5808-84b2-574aeaf528f8 with scrape type 1
2026-03-30 09:01:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38d07482-baa2-5808-84b2-574aeaf528f8 sending to next pipeline
2026-03-30 09:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 38d07482-baa2-5808-84b2-574aeaf528f8, identifier: JW12338
2026-03-30 09:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_dfdfb3fd4738889b5052eb15cd677dd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_a39c65ec93d42774f308253dae02f11e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:50 [auto1.it] INFO: Found listing with ID: TL80990
2026-03-30 09:01:50 [auto1.it] INFO: Found listing with ID: DG05029
2026-03-30 09:01:50 [auto1.it] INFO: Found listing with ID: SB43927
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB43927%27 HTTP/1.1" 200 None
2026-03-30 09:01:50 [auto1.it] INFO: Scrape type for SB43927: 2
2026-03-30 09:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e8028aa-c7c9-5e1a-a315-bce039c4f364 with identifier: SB43927
2026-03-30 09:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8028aa-c7c9-5e1a-a315-bce039c4f364 with scrape type 2
2026-03-30 09:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e8028aa-c7c9-5e1a-a315-bce039c4f364 with scrape type 2
2026-03-30 09:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3e8028aa-c7c9-5e1a-a315-bce039c4f364, identifier: SB43927
2026-03-30 09:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 38d07482-baa2-5808-84b2-574aeaf528f8 with identifier: JW12338
2026-03-30 09:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 38d07482-baa2-5808-84b2-574aeaf528f8 with identifier: JW12338
2026-03-30 09:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 38d07482-baa2-5808-84b2-574aeaf528f8 with identifier: JW12338 to the API
2026-03-30 09:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_bc9303ec624a5cc85d9fd86266a58b7b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:19:00Z',
 'fuel_type': 'diesel',
 'id': '38d07482-baa2-5808-84b2-574aeaf528f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW12338',
 'listing': 'auction',
 'location': 'IT, San Giovanni Teatino',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 264349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d07482-baa2-5808-84b2-574aeaf528f8/38d07482-baa2-5808-84b2-574aeaf528f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_988e35f79581a033993e9219ccc08fad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d07482-baa2-5808-84b2-574aeaf528f8/38d07482-baa2-5808-84b2-574aeaf528f8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_517d24e94300af42c6db42259ab7db6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d07482-baa2-5808-84b2-574aeaf528f8/38d07482-baa2-5808-84b2-574aeaf528f8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_90eff0a02d0e12337a56624e4422df67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d07482-baa2-5808-84b2-574aeaf528f8/38d07482-baa2-5808-84b2-574aeaf528f8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_d5dc262b0a2f3de4fac0e3784f254e59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d07482-baa2-5808-84b2-574aeaf528f8/38d07482-baa2-5808-84b2-574aeaf528f8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/e0/1be0724ac49dd34db52a7cc6ddd94eb6/pa/JW12338_bc9303ec624a5cc85d9fd86266a58b7b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2009}
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW12338%27 HTTP/1.1" 200 None
2026-03-30 09:01:51 [auto1.it] INFO: Saving data for JW12338: {'created_time': 1774861311.137715, 'last_price_update_time': 1774861311.137726, 'auction_closing_time': 1774970340.0}
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JW12338') HTTP/1.1" 204 0
2026-03-30 09:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 905b485c-0fa3-5fcf-9211-e634367836fb with identifier: PF04390
2026-03-30 09:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 905b485c-0fa3-5fcf-9211-e634367836fb with scrape type 1
2026-03-30 09:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 905b485c-0fa3-5fcf-9211-e634367836fb
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_18af8768db3c4b66470834474bb65a4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_18af8768db3c4b66470834474bb65a4a.jpg not downloaded yet
2026-03-30 09:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062294d0>
2026-03-30 09:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fef%252Fa8ef12e5361eb2a58e8c1df611bc24fe%252Fpa%252FZZ37544_052b6800ad5e8ad40c781a23fed168e9.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_052b6800ad5e8ad40c781a23fed168e9.jpg saved to cache
2026-03-30 09:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af38efeb-5cc6-51f7-90cf-d45670006072
2026-03-30 09:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af38efeb-5cc6-51f7-90cf-d45670006072, skipping ID generation
2026-03-30 09:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af38efeb-5cc6-51f7-90cf-d45670006072 with scrape type 1
2026-03-30 09:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af38efeb-5cc6-51f7-90cf-d45670006072 sending to next pipeline
2026-03-30 09:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af38efeb-5cc6-51f7-90cf-d45670006072, identifier: ZZ37544
2026-03-30 09:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_c82416594cc63e7c92f663223c544941.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3e8028aa-c7c9-5e1a-a315-bce039c4f364 with identifier: SB43927
2026-03-30 09:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3e8028aa-c7c9-5e1a-a315-bce039c4f364 with identifier: SB43927
2026-03-30 09:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3e8028aa-c7c9-5e1a-a315-bce039c4f364 with identifier: SB43927 to the API
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:59:05Z',
 'fuel_type': 'diesel',
 'id': '3e8028aa-c7c9-5e1a-a315-bce039c4f364',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB43927',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'R-Klasse',
 'odometer': 144258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-30',
 'seller_name': None,
 'title': 'Mercedes-Benz R-Klasse R 280 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB43927%27 HTTP/1.1" 200 None
2026-03-30 09:01:51 [auto1.it] INFO: Saving data for SB43927: {'auction_closing_time': 1774972745.0, 'created_time': 1773954067.452075, 'last_price_update_time': 1774861311.761066}
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SB43927') HTTP/1.1" 204 0
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_813a9c975de9d9761dad48b24703dff1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_813a9c975de9d9761dad48b24703dff1.jpg not downloaded yet
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_2d2190a1a9071d379ad1110b0ca03636.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_2d2190a1a9071d379ad1110b0ca03636.jpg not downloaded yet
2026-03-30 09:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af38efeb-5cc6-51f7-90cf-d45670006072 with identifier: ZZ37544
2026-03-30 09:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af38efeb-5cc6-51f7-90cf-d45670006072 with identifier: ZZ37544
2026-03-30 09:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af38efeb-5cc6-51f7-90cf-d45670006072 with identifier: ZZ37544 to the API
2026-03-30 09:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_052b6800ad5e8ad40c781a23fed168e9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 320,
 'expiration_date': '2026-03-31T15:50:13Z',
 'fuel_type': 'hybrid',
 'id': 'af38efeb-5cc6-51f7-90cf-d45670006072',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ37544',
 'listing': 'auction',
 'location': 'IT, Corsico',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 95681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_ebc667751ad390c9639355647cd5161b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_b9009952221f6f10e0ca5f348a9d8d80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_2bd06ed62f15ce979f85b6668030a041.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_148132731aab92c862f00314aeec6cd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_052b6800ad5e8ad40c781a23fed168e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_7650eb80a6b576d5e73aeb3736b4baa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_7459cf7a9d31c8c5e8dd847d8a62179d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_2646b7884b90cb456052cfa72f9513c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_28094d1dab5296ea7d05583960019c78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af38efeb-5cc6-51f7-90cf-d45670006072/af38efeb-5cc6-51f7-90cf-d45670006072_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/ef/a8ef12e5361eb2a58e8c1df611bc24fe/pa/ZZ37544_4c692a255ecde6ff6dd00b28e55d7de3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350de 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ37544%27 HTTP/1.1" 200 None
2026-03-30 09:01:52 [auto1.it] INFO: Saving data for ZZ37544: {'created_time': 1774861312.273454, 'last_price_update_time': 1774861312.273464, 'auction_closing_time': 1774972213.0}
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ37544') HTTP/1.1" 204 0
2026-03-30 09:01:52 [auto1.it] INFO: Channel: 24h | Page: 8 | totalHits: 3287 | hits on page: 40
2026-03-30 09:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_1c8df4ee5e6e8b8a56c93df14363743d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:52 [auto1.it] INFO: Found listing with ID: PV19108
2026-03-30 09:01:52 [auto1.it] INFO: Found listing with ID: RT37203
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT37203%27 HTTP/1.1" 200 None
2026-03-30 09:01:52 [auto1.it] INFO: Scrape type for RT37203: 2
2026-03-30 09:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09b4f12e-1bcc-5d42-8bca-fb013866044e with identifier: RT37203
2026-03-30 09:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09b4f12e-1bcc-5d42-8bca-fb013866044e with scrape type 2
2026-03-30 09:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09b4f12e-1bcc-5d42-8bca-fb013866044e with scrape type 2
2026-03-30 09:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 09b4f12e-1bcc-5d42-8bca-fb013866044e, identifier: RT37203
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_a4716d668dc2de1072577912f425901c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_a4716d668dc2de1072577912f425901c.jpg not downloaded yet
2026-03-30 09:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD49777> (referer: https://www.auto1.com/v1/car-details-view/FD49777/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e47950>
2026-03-30 09:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_c01ebb94cc525016ac45b5c97a36e24d.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_c01ebb94cc525016ac45b5c97a36e24d.jpg saved to cache
2026-03-30 09:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3aa0ca40-c085-5e00-af7b-13748b95d30e
2026-03-30 09:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0615a190>
2026-03-30 09:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_623347e62676787c752f7b01a41f4f7b.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_623347e62676787c752f7b01a41f4f7b.jpg saved to cache
2026-03-30 09:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8fe3c62-8193-5792-81f3-d786995a17cf
2026-03-30 09:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06369590>
2026-03-30 09:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956de1facf7ac867d7147f9d335a9c2d%252Fpa%252FNP53767_6f7bcb22c0e3ea355f312fad31c54350.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_6f7bcb22c0e3ea355f312fad31c54350.jpg saved to cache
2026-03-30 09:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a998de2d-1060-5046-bfb5-eaa4b85bacbb
2026-03-30 09:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a998de2d-1060-5046-bfb5-eaa4b85bacbb, skipping ID generation
2026-03-30 09:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a998de2d-1060-5046-bfb5-eaa4b85bacbb with scrape type 1
2026-03-30 09:01:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a998de2d-1060-5046-bfb5-eaa4b85bacbb sending to next pipeline
2026-03-30 09:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a998de2d-1060-5046-bfb5-eaa4b85bacbb, identifier: NP53767
2026-03-30 09:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_55ae13fb268f40b3744e82b3751dd4a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 09b4f12e-1bcc-5d42-8bca-fb013866044e with identifier: RT37203
2026-03-30 09:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 09b4f12e-1bcc-5d42-8bca-fb013866044e with identifier: RT37203
2026-03-30 09:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 09b4f12e-1bcc-5d42-8bca-fb013866044e with identifier: RT37203 to the API
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:33:12Z',
 'fuel_type': 'diesel',
 'id': '09b4f12e-1bcc-5d42-8bca-fb013866044e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT37203',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 168971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT37203%27 HTTP/1.1" 200 None
2026-03-30 09:01:53 [auto1.it] INFO: Saving data for RT37203: {'auction_closing_time': 1774971192.0, 'created_time': 1773135815.441505, 'last_price_update_time': 1774861313.040606}
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT37203') HTTP/1.1" 204 0
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_a95047ba88d4cf66c7c67ff879314eb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_a95047ba88d4cf66c7c67ff879314eb1.jpg not downloaded yet
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_f404d9c64ff718b6e61e388ce4d364c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_f404d9c64ff718b6e61e388ce4d364c4.jpg not downloaded yet
2026-03-30 09:01:53 [auto1.it] INFO: Found listing with ID: BX11661
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX11661%27 HTTP/1.1" 200 None
2026-03-30 09:01:53 [auto1.it] INFO: Scrape type for BX11661: 2
2026-03-30 09:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 330f1f6a-3901-58b4-8484-9893c2a27f60 with identifier: BX11661
2026-03-30 09:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 330f1f6a-3901-58b4-8484-9893c2a27f60 with scrape type 2
2026-03-30 09:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 330f1f6a-3901-58b4-8484-9893c2a27f60 with scrape type 2
2026-03-30 09:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 330f1f6a-3901-58b4-8484-9893c2a27f60, identifier: BX11661
2026-03-30 09:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a998de2d-1060-5046-bfb5-eaa4b85bacbb with identifier: NP53767
2026-03-30 09:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a998de2d-1060-5046-bfb5-eaa4b85bacbb with identifier: NP53767
2026-03-30 09:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a998de2d-1060-5046-bfb5-eaa4b85bacbb with identifier: NP53767 to the API
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_6f7bcb22c0e3ea355f312fad31c54350.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:18:33Z',
 'fuel_type': 'gas',
 'id': 'a998de2d-1060-5046-bfb5-eaa4b85bacbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP53767',
 'listing': 'auction',
 'location': 'IT, Nola',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 102494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_2ada8dca20abcf5d62d057f7b7a9b374.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_b75e5add0010340b0ddcc4e79f7179a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_85d95cb053da054e702d688cae8f2cad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_2ab7ce252ac36903eb8faa24975439c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_0ba88efd8c7ada1adaf29136af93bdf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_18d168f588211ddc34cc75a2cc411864.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_6f7bcb22c0e3ea355f312fad31c54350.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_04d49824df348b05bec5c1c61140c5e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_1e457d621d077dc768ac6484bd3a9e88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a998de2d-1060-5046-bfb5-eaa4b85bacbb/a998de2d-1060-5046-bfb5-eaa4b85bacbb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956de1facf7ac867d7147f9d335a9c2d/pa/NP53767_e289dab750102906e1fde3fa1e5d33f0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP53767%27 HTTP/1.1" 200 None
2026-03-30 09:01:53 [auto1.it] INFO: Saving data for NP53767: {'created_time': 1774861313.687533, 'last_price_update_time': 1774861313.687543, 'auction_closing_time': 1774970313.0}
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NP53767') HTTP/1.1" 204 0
2026-03-30 09:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06203250>
2026-03-30 09:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_dfdfb3fd4738889b5052eb15cd677dd9.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_dfdfb3fd4738889b5052eb15cd677dd9.jpg saved to cache
2026-03-30 09:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8fe3c62-8193-5792-81f3-d786995a17cf
2026-03-30 09:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061596d0>
2026-03-30 09:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_a39c65ec93d42774f308253dae02f11e.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_a39c65ec93d42774f308253dae02f11e.jpg saved to cache
2026-03-30 09:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8fe3c62-8193-5792-81f3-d786995a17cf
2026-03-30 09:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_326f9dee8768a649eecd38715ba6d4e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_4571eddf4802a96ba5d4493c87d9632f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:53 [auto1.it] INFO: Found listing with ID: DW74662
2026-03-30 09:01:53 [auto1.it] INFO: Found listing with ID: DA96064
2026-03-30 09:01:53 [auto1.it] INFO: Found listing with ID: SD84714
2026-03-30 09:01:53 [auto1.it] INFO: Found listing with ID: CY17500
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY17500%27 HTTP/1.1" 200 None
2026-03-30 09:01:53 [auto1.it] INFO: Scrape type for CY17500: 2
2026-03-30 09:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a32bb9ef-4697-5e38-8000-35e9a6251446 with identifier: CY17500
2026-03-30 09:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a32bb9ef-4697-5e38-8000-35e9a6251446 with scrape type 2
2026-03-30 09:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a32bb9ef-4697-5e38-8000-35e9a6251446 with scrape type 2
2026-03-30 09:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a32bb9ef-4697-5e38-8000-35e9a6251446, identifier: CY17500
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_67900bd255907cd4ee58a4f171f920dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_67900bd255907cd4ee58a4f171f920dc.jpg not downloaded yet
2026-03-30 09:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 330f1f6a-3901-58b4-8484-9893c2a27f60 with identifier: BX11661
2026-03-30 09:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 330f1f6a-3901-58b4-8484-9893c2a27f60 with identifier: BX11661
2026-03-30 09:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 330f1f6a-3901-58b4-8484-9893c2a27f60 with identifier: BX11661 to the API
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:39:31Z',
 'fuel_type': 'diesel',
 'id': '330f1f6a-3901-58b4-8484-9893c2a27f60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX11661',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 110460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX11661%27 HTTP/1.1" 200 None
2026-03-30 09:01:54 [auto1.it] INFO: Saving data for BX11661: {'auction_closing_time': 1774971571.0, 'created_time': 1774353874.483482, 'last_price_update_time': 1774861314.355105}
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BX11661') HTTP/1.1" 204 0
2026-03-30 09:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c6a050>
2026-03-30 09:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_c82416594cc63e7c92f663223c544941.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_c82416594cc63e7c92f663223c544941.jpg saved to cache
2026-03-30 09:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3aa0ca40-c085-5e00-af7b-13748b95d30e
2026-03-30 09:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a32bb9ef-4697-5e38-8000-35e9a6251446 with identifier: CY17500
2026-03-30 09:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a32bb9ef-4697-5e38-8000-35e9a6251446 with identifier: CY17500
2026-03-30 09:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a32bb9ef-4697-5e38-8000-35e9a6251446 with identifier: CY17500 to the API
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:00:13Z',
 'fuel_type': 'diesel',
 'id': 'a32bb9ef-4697-5e38-8000-35e9a6251446',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY17500',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 326519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-08',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Executive BlueMotion',
 'transmission': 'automatic',
 'trim': 'Executive BlueMotion',
 'year': 2017}
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY17500%27 HTTP/1.1" 200 None
2026-03-30 09:01:54 [auto1.it] INFO: Saving data for CY17500: {'auction_closing_time': 1774969213.0, 'created_time': 1774342837.784724, 'last_price_update_time': 1774861314.795464}
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CY17500') HTTP/1.1" 204 0
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_fd2a2e99ec2df0bbb72f1d78dca5b40f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_fd2a2e99ec2df0bbb72f1d78dca5b40f.jpg not downloaded yet
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_f1fa1b174f55150a67f5821e78009314.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_f1fa1b174f55150a67f5821e78009314.jpg not downloaded yet
2026-03-30 09:01:54 [auto1.it] INFO: Found listing with ID: FV31205
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV31205%27 HTTP/1.1" 200 None
2026-03-30 09:01:54 [auto1.it] INFO: Scrape type for FV31205: 2
2026-03-30 09:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f66b1df4-d6dd-5beb-84a0-54996a398566 with identifier: FV31205
2026-03-30 09:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f66b1df4-d6dd-5beb-84a0-54996a398566 with scrape type 2
2026-03-30 09:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f66b1df4-d6dd-5beb-84a0-54996a398566 with scrape type 2
2026-03-30 09:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f66b1df4-d6dd-5beb-84a0-54996a398566, identifier: FV31205
2026-03-30 09:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VU13250/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV41912/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c84f90>
2026-03-30 09:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_1c8df4ee5e6e8b8a56c93df14363743d.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_1c8df4ee5e6e8b8a56c93df14363743d.jpg saved to cache
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8fe3c62-8193-5792-81f3-d786995a17cf
2026-03-30 09:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83543928-badb-5fd7-a00d-ccf4aa045b8a with identifier: FD49777
2026-03-30 09:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83543928-badb-5fd7-a00d-ccf4aa045b8a with scrape type 1
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83543928-badb-5fd7-a00d-ccf4aa045b8a
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F02%252F3f026f34a3c614da010fcd8831ef4f91%252Fpa%252FFD49777_c38df43a1366f1c7782dfea9a595bdb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_c38df43a1366f1c7782dfea9a595bdb7.jpg already downloaded
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F02%252F3f026f34a3c614da010fcd8831ef4f91%252Fpa%252FFD49777_283d121779ff2240f99cd8aa261f0f57.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_283d121779ff2240f99cd8aa261f0f57.jpg already downloaded
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F02%252F3f026f34a3c614da010fcd8831ef4f91%252Fpa%252FFD49777_a92c3fb37336d6fe117c5dd27558a884.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_a92c3fb37336d6fe117c5dd27558a884.jpg already downloaded
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F02%252F3f026f34a3c614da010fcd8831ef4f91%252Fpa%252FFD49777_9f1e82cd2921e83afb6b7da1a7c064d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_9f1e82cd2921e83afb6b7da1a7c064d8.jpg already downloaded
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F02%252F3f026f34a3c614da010fcd8831ef4f91%252Fpa%252FFD49777_ca19f2cb8f0c25d67858f2a85e315327.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_ca19f2cb8f0c25d67858f2a85e315327.jpg already downloaded
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F02%252F3f026f34a3c614da010fcd8831ef4f91%252Fpa%252FFD49777_45c823bb130f42544f49c31b685b79e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_45c823bb130f42544f49c31b685b79e4.jpg already downloaded
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F02%252F3f026f34a3c614da010fcd8831ef4f91%252Fpa%252FFD49777_63b31925d08c043384ee6dd94b48f3d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_63b31925d08c043384ee6dd94b48f3d2.jpg already downloaded
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F02%252F3f026f34a3c614da010fcd8831ef4f91%252Fpa%252FFD49777_bfa429edc1b3846b5d715867b63a222b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_bfa429edc1b3846b5d715867b63a222b.jpg already downloaded
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F02%252F3f026f34a3c614da010fcd8831ef4f91%252Fpa%252FFD49777_11d9016ee79ad3d101b2faeb2555a7a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_11d9016ee79ad3d101b2faeb2555a7a4.jpg already downloaded
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F02%252F3f026f34a3c614da010fcd8831ef4f91%252Fpa%252FFD49777_2a34f0857624503d1a7a1474593bc12d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_2a34f0857624503d1a7a1474593bc12d.jpg already downloaded
2026-03-30 09:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 83543928-badb-5fd7-a00d-ccf4aa045b8a, identifier: FD49777
2026-03-30 09:01:55 [auto1.it] INFO: Found listing with ID: WE25816
2026-03-30 09:01:55 [auto1.it] INFO: Found listing with ID: RV54155
2026-03-30 09:01:55 [auto1.it] INFO: Found listing with ID: XX98106
2026-03-30 09:01:55 [auto1.it] INFO: Found listing with ID: LP02443
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP02443%27 HTTP/1.1" 200 None
2026-03-30 09:01:55 [auto1.it] INFO: Scrape type for LP02443: 2
2026-03-30 09:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8be32dc0-9b65-55a0-bdab-150fff644f3c with identifier: LP02443
2026-03-30 09:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8be32dc0-9b65-55a0-bdab-150fff644f3c with scrape type 2
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8be32dc0-9b65-55a0-bdab-150fff644f3c with scrape type 2
2026-03-30 09:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8be32dc0-9b65-55a0-bdab-150fff644f3c, identifier: LP02443
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_26256165a0fea9aa78b1e6934e0b3133.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_26256165a0fea9aa78b1e6934e0b3133.jpg not downloaded yet
2026-03-30 09:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f66b1df4-d6dd-5beb-84a0-54996a398566 with identifier: FV31205
2026-03-30 09:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f66b1df4-d6dd-5beb-84a0-54996a398566 with identifier: FV31205
2026-03-30 09:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f66b1df4-d6dd-5beb-84a0-54996a398566 with identifier: FV31205 to the API
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:35:11Z',
 'fuel_type': 'diesel',
 'id': 'f66b1df4-d6dd-5beb-84a0-54996a398566',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV31205',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 281793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-29',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2011}
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV31205%27 HTTP/1.1" 200 None
2026-03-30 09:01:56 [auto1.it] INFO: Saving data for FV31205: {'auction_closing_time': 1774971311.0, 'created_time': 1774472584.661018, 'last_price_update_time': 1774861316.073485}
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FV31205') HTTP/1.1" 204 0
2026-03-30 09:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM54486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 83543928-badb-5fd7-a00d-ccf4aa045b8a with identifier: FD49777
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 09:01:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 83543928-badb-5fd7-a00d-ccf4aa045b8a with identifier: FD49777
2026-03-30 09:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 83543928-badb-5fd7-a00d-ccf4aa045b8a with identifier: FD49777 to the API
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FD49777>
{'auction_title': '',
 'c_o_2_emission_value': 26,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'expiration_date': '2026-03-31T15:20:10Z',
 'fuel_type': 'hybrid',
 'id': '83543928-badb-5fd7-a00d-ccf4aa045b8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD49777',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 49612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_c38df43a1366f1c7782dfea9a595bdb7.jpg',
                'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_283d121779ff2240f99cd8aa261f0f57.jpg',
                'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_a92c3fb37336d6fe117c5dd27558a884.jpg',
                'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_9f1e82cd2921e83afb6b7da1a7c064d8.jpg',
                'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_ca19f2cb8f0c25d67858f2a85e315327.jpg',
                'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_45c823bb130f42544f49c31b685b79e4.jpg',
                'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_63b31925d08c043384ee6dd94b48f3d2.jpg',
                'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_bfa429edc1b3846b5d715867b63a222b.jpg',
                'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_11d9016ee79ad3d101b2faeb2555a7a4.jpg',
                'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_2a34f0857624503d1a7a1474593bc12d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83543928-badb-5fd7-a00d-ccf4aa045b8a/83543928-badb-5fd7-a00d-ccf4aa045b8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_c38df43a1366f1c7782dfea9a595bdb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83543928-badb-5fd7-a00d-ccf4aa045b8a/83543928-badb-5fd7-a00d-ccf4aa045b8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_283d121779ff2240f99cd8aa261f0f57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83543928-badb-5fd7-a00d-ccf4aa045b8a/83543928-badb-5fd7-a00d-ccf4aa045b8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_a92c3fb37336d6fe117c5dd27558a884.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83543928-badb-5fd7-a00d-ccf4aa045b8a/83543928-badb-5fd7-a00d-ccf4aa045b8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_9f1e82cd2921e83afb6b7da1a7c064d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83543928-badb-5fd7-a00d-ccf4aa045b8a/83543928-badb-5fd7-a00d-ccf4aa045b8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_ca19f2cb8f0c25d67858f2a85e315327.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83543928-badb-5fd7-a00d-ccf4aa045b8a/83543928-badb-5fd7-a00d-ccf4aa045b8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_45c823bb130f42544f49c31b685b79e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83543928-badb-5fd7-a00d-ccf4aa045b8a/83543928-badb-5fd7-a00d-ccf4aa045b8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_63b31925d08c043384ee6dd94b48f3d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83543928-badb-5fd7-a00d-ccf4aa045b8a/83543928-badb-5fd7-a00d-ccf4aa045b8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_bfa429edc1b3846b5d715867b63a222b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83543928-badb-5fd7-a00d-ccf4aa045b8a/83543928-badb-5fd7-a00d-ccf4aa045b8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_11d9016ee79ad3d101b2faeb2555a7a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83543928-badb-5fd7-a00d-ccf4aa045b8a/83543928-badb-5fd7-a00d-ccf4aa045b8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/02/3f026f34a3c614da010fcd8831ef4f91/pa/FD49777_2a34f0857624503d1a7a1474593bc12d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Hybrid GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD49777%27 HTTP/1.1" 200 None
2026-03-30 09:01:56 [auto1.it] INFO: Saving data for FD49777: {'created_time': 1774861316.730412, 'last_price_update_time': 1774861316.730423, 'auction_closing_time': 1774970410.0}
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FD49777') HTTP/1.1" 204 0
2026-03-30 09:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c191d0>
2026-03-30 09:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_55ae13fb268f40b3744e82b3751dd4a3.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_55ae13fb268f40b3744e82b3751dd4a3.jpg saved to cache
2026-03-30 09:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8fe3c62-8193-5792-81f3-d786995a17cf
2026-03-30 09:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8be32dc0-9b65-55a0-bdab-150fff644f3c with identifier: LP02443
2026-03-30 09:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8be32dc0-9b65-55a0-bdab-150fff644f3c with identifier: LP02443
2026-03-30 09:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8be32dc0-9b65-55a0-bdab-150fff644f3c with identifier: LP02443 to the API
2026-03-30 09:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:00Z',
 'fuel_type': 'diesel',
 'id': '8be32dc0-9b65-55a0-bdab-150fff644f3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP02443',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 101604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-28',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2019}
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP02443%27 HTTP/1.1" 200 None
2026-03-30 09:01:57 [auto1.it] INFO: Saving data for LP02443: {'auction_closing_time': 1774971720.0, 'created_time': 1774429259.846963, 'last_price_update_time': 1774861317.188035}
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LP02443') HTTP/1.1" 204 0
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_a0bff0f07754123cc29507454fb4f24d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_a0bff0f07754123cc29507454fb4f24d.jpg not downloaded yet
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_e27067b30cec58215e5c2ceb3ad3406b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_e27067b30cec58215e5c2ceb3ad3406b.jpg not downloaded yet
2026-03-30 09:01:57 [auto1.it] INFO: Found listing with ID: GN01544
2026-03-30 09:01:57 [auto1.it] INFO: Found listing with ID: KT03985
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT03985%27 HTTP/1.1" 200 None
2026-03-30 09:01:57 [auto1.it] INFO: Scrape type for KT03985: 2
2026-03-30 09:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad23b6f4-b39a-582a-9bdf-964212f56355 with identifier: KT03985
2026-03-30 09:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad23b6f4-b39a-582a-9bdf-964212f56355 with scrape type 2
2026-03-30 09:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad23b6f4-b39a-582a-9bdf-964212f56355 with scrape type 2
2026-03-30 09:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ad23b6f4-b39a-582a-9bdf-964212f56355, identifier: KT03985
2026-03-30 09:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB63640> (referer: https://www.auto1.com/v1/car-details-view/UB63640/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT52131/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e8b090>
2026-03-30 09:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F39%252F3a39c7631389641e25df30359f43f5b0%252Fpa%252FGV71970_326f9dee8768a649eecd38715ba6d4e7.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_326f9dee8768a649eecd38715ba6d4e7.jpg saved to cache
2026-03-30 09:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8fe3c62-8193-5792-81f3-d786995a17cf
2026-03-30 09:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8fe3c62-8193-5792-81f3-d786995a17cf, skipping ID generation
2026-03-30 09:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8fe3c62-8193-5792-81f3-d786995a17cf with scrape type 1
2026-03-30 09:01:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8fe3c62-8193-5792-81f3-d786995a17cf sending to next pipeline
2026-03-30 09:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f8fe3c62-8193-5792-81f3-d786995a17cf, identifier: GV71970
2026-03-30 09:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0624acd0>
2026-03-30 09:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F7d%252Fbd7dc3724fe860dc0f54c0c09a82e27f%252Fpa%252FWY72702_4571eddf4802a96ba5d4493c87d9632f.jpg') HTTP/1.1" 204 0
2026-03-30 09:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_4571eddf4802a96ba5d4493c87d9632f.jpg saved to cache
2026-03-30 09:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3aa0ca40-c085-5e00-af7b-13748b95d30e
2026-03-30 09:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3aa0ca40-c085-5e00-af7b-13748b95d30e, skipping ID generation
2026-03-30 09:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3aa0ca40-c085-5e00-af7b-13748b95d30e with scrape type 1
2026-03-30 09:01:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3aa0ca40-c085-5e00-af7b-13748b95d30e sending to next pipeline
2026-03-30 09:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3aa0ca40-c085-5e00-af7b-13748b95d30e, identifier: WY72702
2026-03-30 09:01:57 [auto1.it] INFO: Found listing with ID: YJ98876
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ98876%27 HTTP/1.1" 200 None
2026-03-30 09:01:57 [auto1.it] INFO: Scrape type for YJ98876: 2
2026-03-30 09:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bc3ff41-fbc9-5e0f-bc21-719b8b705918 with identifier: YJ98876
2026-03-30 09:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc3ff41-fbc9-5e0f-bc21-719b8b705918 with scrape type 2
2026-03-30 09:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bc3ff41-fbc9-5e0f-bc21-719b8b705918 with scrape type 2
2026-03-30 09:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7bc3ff41-fbc9-5e0f-bc21-719b8b705918, identifier: YJ98876
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_c0a210b1fd149ea0ecf4bbf7a8478457.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_c0a210b1fd149ea0ecf4bbf7a8478457.jpg not downloaded yet
2026-03-30 09:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ad23b6f4-b39a-582a-9bdf-964212f56355 with identifier: KT03985
2026-03-30 09:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ad23b6f4-b39a-582a-9bdf-964212f56355 with identifier: KT03985
2026-03-30 09:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ad23b6f4-b39a-582a-9bdf-964212f56355 with identifier: KT03985 to the API
2026-03-30 09:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:29:49Z',
 'fuel_type': 'diesel',
 'id': 'ad23b6f4-b39a-582a-9bdf-964212f56355',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT03985',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 248253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-19',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTDM Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2012}
2026-03-30 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT03985%27 HTTP/1.1" 200 None
2026-03-30 09:01:58 [auto1.it] INFO: Saving data for KT03985: {'auction_closing_time': 1774970989.0, 'created_time': 1773500456.633037, 'last_price_update_time': 1774861318.659793}
2026-03-30 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT03985') HTTP/1.1" 204 0
2026-03-30 09:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f8fe3c62-8193-5792-81f3-d786995a17cf with identifier: GV71970
2026-03-30 09:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f8fe3c62-8193-5792-81f3-d786995a17cf with identifier: GV71970
2026-03-30 09:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f8fe3c62-8193-5792-81f3-d786995a17cf with identifier: GV71970 to the API
2026-03-30 09:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_326f9dee8768a649eecd38715ba6d4e7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 107,
 'expiration_date': '2026-03-31T15:35:54Z',
 'fuel_type': 'diesel',
 'id': 'f8fe3c62-8193-5792-81f3-d786995a17cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV71970',
 'listing': 'auction',
 'location': 'IT, Piacenza',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 182799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_326f9dee8768a649eecd38715ba6d4e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_55ae13fb268f40b3744e82b3751dd4a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_1c8df4ee5e6e8b8a56c93df14363743d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_dfdfb3fd4738889b5052eb15cd677dd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_a39c65ec93d42774f308253dae02f11e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_623347e62676787c752f7b01a41f4f7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_abdcfc2efc270531e9bb8e6a4858db33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_401efd59c31819af9c0e63ec538e6993.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_e6745a9674c346ebaea435c2361a9b92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fe3c62-8193-5792-81f3-d786995a17cf/f8fe3c62-8193-5792-81f3-d786995a17cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/39/3a39c7631389641e25df30359f43f5b0/pa/GV71970_f9cf1de9bb18ff4f006751522a0c0f90.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Ambiance 4x2',
 'transmission': 'manual',
 'trim': 'Ambiance 4x2',
 'year': 2013}
2026-03-30 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV71970%27 HTTP/1.1" 200 None
2026-03-30 09:01:59 [auto1.it] INFO: Saving data for GV71970: {'created_time': 1774861319.506035, 'last_price_update_time': 1774861319.506045, 'auction_closing_time': 1774971354.0}
2026-03-30 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GV71970') HTTP/1.1" 204 0
2026-03-30 09:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3aa0ca40-c085-5e00-af7b-13748b95d30e with identifier: WY72702
2026-03-30 09:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3aa0ca40-c085-5e00-af7b-13748b95d30e with identifier: WY72702
2026-03-30 09:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3aa0ca40-c085-5e00-af7b-13748b95d30e with identifier: WY72702 to the API
2026-03-30 09:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_4571eddf4802a96ba5d4493c87d9632f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 249,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.3L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:07:19Z',
 'fuel_type': 'diesel',
 'id': '3aa0ca40-c085-5e00-af7b-13748b95d30e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY72702',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Nissan',
 'model': 'Navara NP-300',
 'odometer': 167520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_4571eddf4802a96ba5d4493c87d9632f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_6d0aa6ccd5b9214628ced7ecd907c2f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_c82416594cc63e7c92f663223c544941.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_a7e85451ef41d9db788b677742bd9855.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_c01ebb94cc525016ac45b5c97a36e24d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_aced8fec8dd67c4789c7e05b7ecff3fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_f98c98b357936a720d8c06cbc9bd0fe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_7273adac52d7337df5ff91a1e0daa93d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_b78a84f261e3a3d30ce7f92660217606.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa0ca40-c085-5e00-af7b-13748b95d30e/3aa0ca40-c085-5e00-af7b-13748b95d30e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/7d/bd7dc3724fe860dc0f54c0c09a82e27f/pa/WY72702_accf28a5a5b427fa42e31f7ff38fb717.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Navara NP-300 2.3 dCi N-Guard Double Cab 4x4',
 'transmission': 'automatic',
 'trim': 'N-Guard Double Cab 4x4',
 'year': 2021}
2026-03-30 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY72702%27 HTTP/1.1" 200 None
2026-03-30 09:01:59 [auto1.it] INFO: Saving data for WY72702: {'created_time': 1774861319.9579, 'last_price_update_time': 1774861319.957911, 'auction_closing_time': 1774969639.0}
2026-03-30 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WY72702') HTTP/1.1" 204 0
2026-03-30 09:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_813a9c975de9d9761dad48b24703dff1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7bc3ff41-fbc9-5e0f-bc21-719b8b705918 with identifier: YJ98876
2026-03-30 09:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7bc3ff41-fbc9-5e0f-bc21-719b8b705918 with identifier: YJ98876
2026-03-30 09:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7bc3ff41-fbc9-5e0f-bc21-719b8b705918 with identifier: YJ98876 to the API
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:08:09Z',
 'fuel_type': 'diesel',
 'id': '7bc3ff41-fbc9-5e0f-bc21-719b8b705918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ98876',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 124137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-13',
 'seller_name': None,
 'title': 'BMW 4er 420d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ98876%27 HTTP/1.1" 200 None
2026-03-30 09:02:00 [auto1.it] INFO: Saving data for YJ98876: {'auction_closing_time': 1774969689.0, 'created_time': 1774386196.241341, 'last_price_update_time': 1774861320.74864}
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YJ98876') HTTP/1.1" 204 0
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_798dda77b6057d348315c1f402a94493.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_798dda77b6057d348315c1f402a94493.jpg not downloaded yet
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_4a0a789ab5e2fd2ff5459dc3d4d63bde.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_4a0a789ab5e2fd2ff5459dc3d4d63bde.jpg not downloaded yet
2026-03-30 09:02:00 [auto1.it] INFO: Found listing with ID: TM60577
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM60577%27 HTTP/1.1" 200 None
2026-03-30 09:02:00 [auto1.it] INFO: Scrape type for TM60577: 2
2026-03-30 09:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c204f28-6657-54ce-892c-d8002d941f1e with identifier: TM60577
2026-03-30 09:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c204f28-6657-54ce-892c-d8002d941f1e with scrape type 2
2026-03-30 09:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c204f28-6657-54ce-892c-d8002d941f1e with scrape type 2
2026-03-30 09:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c204f28-6657-54ce-892c-d8002d941f1e, identifier: TM60577
2026-03-30 09:02:00 [auto1.it] INFO: Found listing with ID: MH70269
2026-03-30 09:02:00 [auto1.it] INFO: Found listing with ID: VC90612
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC90612%27 HTTP/1.1" 200 None
2026-03-30 09:02:00 [auto1.it] INFO: Scrape type for VC90612: 2
2026-03-30 09:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 205e4cb7-1b91-5d18-bea3-a6338c427e1c with identifier: VC90612
2026-03-30 09:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 205e4cb7-1b91-5d18-bea3-a6338c427e1c with scrape type 2
2026-03-30 09:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 205e4cb7-1b91-5d18-bea3-a6338c427e1c with scrape type 2
2026-03-30 09:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 205e4cb7-1b91-5d18-bea3-a6338c427e1c, identifier: VC90612
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_cfe6690abd508fc59e139f03029ff22f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_cfe6690abd508fc59e139f03029ff22f.jpg not downloaded yet
2026-03-30 09:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c204f28-6657-54ce-892c-d8002d941f1e with identifier: TM60577
2026-03-30 09:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c204f28-6657-54ce-892c-d8002d941f1e with identifier: TM60577
2026-03-30 09:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c204f28-6657-54ce-892c-d8002d941f1e with identifier: TM60577 to the API
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:11:56Z',
 'fuel_type': 'diesel',
 'id': '6c204f28-6657-54ce-892c-d8002d941f1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM60577',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 192122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-29',
 'seller_name': None,
 'title': 'Mazda 3 2.2 Turbodiesel Exceed',
 'transmission': 'automatic',
 'trim': 'Exceed',
 'year': 2018}
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM60577%27 HTTP/1.1" 200 None
2026-03-30 09:02:01 [auto1.it] INFO: Saving data for TM60577: {'auction_closing_time': 1774969916.0, 'created_time': 1774447268.301732, 'last_price_update_time': 1774861321.543759}
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TM60577') HTTP/1.1" 204 0
2026-03-30 09:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdc75bcf-2509-5b37-a792-79e28573db64 with identifier: UB63640
2026-03-30 09:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdc75bcf-2509-5b37-a792-79e28573db64 with scrape type 1
2026-03-30 09:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fdc75bcf-2509-5b37-a792-79e28573db64
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_de8e75c09810341076dabd1280132e11.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_de8e75c09810341076dabd1280132e11.jpg not downloaded yet
2026-03-30 09:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 205e4cb7-1b91-5d18-bea3-a6338c427e1c with identifier: VC90612
2026-03-30 09:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 205e4cb7-1b91-5d18-bea3-a6338c427e1c with identifier: VC90612
2026-03-30 09:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 205e4cb7-1b91-5d18-bea3-a6338c427e1c with identifier: VC90612 to the API
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:30:21Z',
 'fuel_type': 'petrol',
 'id': '205e4cb7-1b91-5d18-bea3-a6338c427e1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC90612',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 227539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-23',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2010}
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC90612%27 HTTP/1.1" 200 None
2026-03-30 09:02:01 [auto1.it] INFO: Saving data for VC90612: {'auction_closing_time': 1774971021.0, 'created_time': 1773910837.206692, 'last_price_update_time': 1774861321.993235}
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VC90612') HTTP/1.1" 204 0
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_afd7e0653e285a8768a06010baeaba25.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_afd7e0653e285a8768a06010baeaba25.jpg not downloaded yet
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_ac9ab0c28779a53846340a78af8c6fac.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_ac9ab0c28779a53846340a78af8c6fac.jpg not downloaded yet
2026-03-30 09:02:02 [auto1.it] INFO: Found listing with ID: AS05452
2026-03-30 09:02:02 [auto1.it] INFO: Found listing with ID: AK38143
2026-03-30 09:02:02 [auto1.it] INFO: Found listing with ID: SC61434
2026-03-30 09:02:02 [auto1.it] INFO: Found listing with ID: UH38063
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH38063%27 HTTP/1.1" 200 None
2026-03-30 09:02:02 [auto1.it] INFO: Scrape type for UH38063: 2
2026-03-30 09:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b859549d-3d52-54a9-bd81-e8a40dbadd8c with identifier: UH38063
2026-03-30 09:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b859549d-3d52-54a9-bd81-e8a40dbadd8c with scrape type 2
2026-03-30 09:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b859549d-3d52-54a9-bd81-e8a40dbadd8c with scrape type 2
2026-03-30 09:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b859549d-3d52-54a9-bd81-e8a40dbadd8c, identifier: UH38063
2026-03-30 09:02:02 [auto1.it] INFO: Found listing with ID: YX73536
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX73536%27 HTTP/1.1" 200 None
2026-03-30 09:02:02 [auto1.it] INFO: Scrape type for YX73536: 2
2026-03-30 09:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3422c7c1-7556-52a8-96d1-a9a6130af4cd with identifier: YX73536
2026-03-30 09:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3422c7c1-7556-52a8-96d1-a9a6130af4cd with scrape type 2
2026-03-30 09:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3422c7c1-7556-52a8-96d1-a9a6130af4cd with scrape type 2
2026-03-30 09:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3422c7c1-7556-52a8-96d1-a9a6130af4cd, identifier: YX73536
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_e88771ca1650d7d7b17594ea15649487.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_e88771ca1650d7d7b17594ea15649487.jpg not downloaded yet
2026-03-30 09:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b859549d-3d52-54a9-bd81-e8a40dbadd8c with identifier: UH38063
2026-03-30 09:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b859549d-3d52-54a9-bd81-e8a40dbadd8c with identifier: UH38063
2026-03-30 09:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b859549d-3d52-54a9-bd81-e8a40dbadd8c with identifier: UH38063 to the API
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:27:19Z',
 'fuel_type': 'diesel',
 'id': 'b859549d-3d52-54a9-bd81-e8a40dbadd8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH38063',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 52210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 1.5 CDTI Business Elegance',
 'transmission': 'automatic',
 'trim': 'Business Elegance',
 'year': 2020}
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH38063%27 HTTP/1.1" 200 None
2026-03-30 09:02:02 [auto1.it] INFO: Saving data for UH38063: {'auction_closing_time': 1774970839.0, 'created_time': 1774472700.590744, 'last_price_update_time': 1774861322.647307}
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UH38063') HTTP/1.1" 204 0
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_5b5afa087977ba4155139fad1fe93b63.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_5b5afa087977ba4155139fad1fe93b63.jpg not downloaded yet
2026-03-30 09:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c110d0>
2026-03-30 09:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_813a9c975de9d9761dad48b24703dff1.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_813a9c975de9d9761dad48b24703dff1.jpg saved to cache
2026-03-30 09:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205
2026-03-30 09:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3422c7c1-7556-52a8-96d1-a9a6130af4cd with identifier: YX73536
2026-03-30 09:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3422c7c1-7556-52a8-96d1-a9a6130af4cd with identifier: YX73536
2026-03-30 09:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3422c7c1-7556-52a8-96d1-a9a6130af4cd with identifier: YX73536 to the API
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:00:03Z',
 'fuel_type': 'diesel',
 'id': '3422c7c1-7556-52a8-96d1-a9a6130af4cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX73536',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 204564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-31',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.6 JTD Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2010}
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX73536%27 HTTP/1.1" 200 None
2026-03-30 09:02:03 [auto1.it] INFO: Saving data for YX73536: {'auction_closing_time': 1774969203.0, 'created_time': 1773241706.598909, 'last_price_update_time': 1774861323.260233}
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YX73536') HTTP/1.1" 204 0
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_1451f180ad5cb35f4a6dcd69095542ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_1451f180ad5cb35f4a6dcd69095542ca.jpg not downloaded yet
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_05deff3d6bba88f307db676da6db3f2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_05deff3d6bba88f307db676da6db3f2a.jpg not downloaded yet
2026-03-30 09:02:03 [auto1.it] INFO: Found listing with ID: EW60341
2026-03-30 09:02:03 [auto1.it] INFO: Found listing with ID: RR79124
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR79124%27 HTTP/1.1" 200 None
2026-03-30 09:02:03 [auto1.it] INFO: Scrape type for RR79124: 2
2026-03-30 09:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 713defe8-b19b-5357-a989-e089fafa204f with identifier: RR79124
2026-03-30 09:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 713defe8-b19b-5357-a989-e089fafa204f with scrape type 2
2026-03-30 09:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 713defe8-b19b-5357-a989-e089fafa204f with scrape type 2
2026-03-30 09:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 713defe8-b19b-5357-a989-e089fafa204f, identifier: RR79124
2026-03-30 09:02:03 [auto1.it] INFO: Found listing with ID: WT52400
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT52400%27 HTTP/1.1" 200 None
2026-03-30 09:02:03 [auto1.it] INFO: Scrape type for WT52400: 2
2026-03-30 09:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2952291e-1312-5cd1-bc28-844318475a95 with identifier: WT52400
2026-03-30 09:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2952291e-1312-5cd1-bc28-844318475a95 with scrape type 2
2026-03-30 09:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2952291e-1312-5cd1-bc28-844318475a95 with scrape type 2
2026-03-30 09:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2952291e-1312-5cd1-bc28-844318475a95, identifier: WT52400
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_5dc3e59bfa2a43dfb88fe13fcd32eb6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_5dc3e59bfa2a43dfb88fe13fcd32eb6e.jpg not downloaded yet
2026-03-30 09:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 713defe8-b19b-5357-a989-e089fafa204f with identifier: RR79124
2026-03-30 09:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 713defe8-b19b-5357-a989-e089fafa204f with identifier: RR79124
2026-03-30 09:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 713defe8-b19b-5357-a989-e089fafa204f with identifier: RR79124 to the API
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:15:54Z',
 'fuel_type': 'diesel',
 'id': '713defe8-b19b-5357-a989-e089fafa204f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR79124',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 37572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-28',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR79124%27 HTTP/1.1" 200 None
2026-03-30 09:02:03 [auto1.it] INFO: Saving data for RR79124: {'auction_closing_time': 1774970154.0, 'created_time': 1774353936.002318, 'last_price_update_time': 1774861323.931336}
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RR79124') HTTP/1.1" 204 0
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_7e01eba25774c5867a46a24147b54264.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_7e01eba25774c5867a46a24147b54264.jpg not downloaded yet
2026-03-30 09:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2952291e-1312-5cd1-bc28-844318475a95 with identifier: WT52400
2026-03-30 09:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2952291e-1312-5cd1-bc28-844318475a95 with identifier: WT52400
2026-03-30 09:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2952291e-1312-5cd1-bc28-844318475a95 with identifier: WT52400 to the API
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:21:49Z',
 'fuel_type': 'petrol',
 'id': '2952291e-1312-5cd1-bc28-844318475a95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT52400',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 92055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-29',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Cult',
 'transmission': 'manual',
 'trim': 'Cult',
 'year': 2021}
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT52400%27 HTTP/1.1" 200 None
2026-03-30 09:02:04 [auto1.it] INFO: Saving data for WT52400: {'auction_closing_time': 1774970509.0, 'created_time': 1773236536.290004, 'last_price_update_time': 1774861324.391768}
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WT52400') HTTP/1.1" 204 0
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_cd5616d31cf897cfa3527aec8a7f6a95.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_cd5616d31cf897cfa3527aec8a7f6a95.jpg not downloaded yet
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_d0dcffb6990941680fed2cf21c224004.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_d0dcffb6990941680fed2cf21c224004.jpg not downloaded yet
2026-03-30 09:02:04 [auto1.it] INFO: Found listing with ID: LC66242
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC66242%27 HTTP/1.1" 200 None
2026-03-30 09:02:04 [auto1.it] INFO: Scrape type for LC66242: 2
2026-03-30 09:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef75bb0e-55cd-59d0-95f6-747aba4a0390 with identifier: LC66242
2026-03-30 09:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef75bb0e-55cd-59d0-95f6-747aba4a0390 with scrape type 2
2026-03-30 09:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef75bb0e-55cd-59d0-95f6-747aba4a0390 with scrape type 2
2026-03-30 09:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ef75bb0e-55cd-59d0-95f6-747aba4a0390, identifier: LC66242
2026-03-30 09:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ03272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:04 [auto1.it] INFO: Found listing with ID: HS01287
2026-03-30 09:02:04 [auto1.it] INFO: Found listing with ID: AE23716
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE23716%27 HTTP/1.1" 200 None
2026-03-30 09:02:04 [auto1.it] INFO: Scrape type for AE23716: 2
2026-03-30 09:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a69af31-a41d-53a9-8556-085572af4916 with identifier: AE23716
2026-03-30 09:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a69af31-a41d-53a9-8556-085572af4916 with scrape type 2
2026-03-30 09:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a69af31-a41d-53a9-8556-085572af4916 with scrape type 2
2026-03-30 09:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a69af31-a41d-53a9-8556-085572af4916, identifier: AE23716
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_96107a934f6aa0a6785b2522a63dda6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_96107a934f6aa0a6785b2522a63dda6d.jpg not downloaded yet
2026-03-30 09:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ef75bb0e-55cd-59d0-95f6-747aba4a0390 with identifier: LC66242
2026-03-30 09:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ef75bb0e-55cd-59d0-95f6-747aba4a0390 with identifier: LC66242
2026-03-30 09:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ef75bb0e-55cd-59d0-95f6-747aba4a0390 with identifier: LC66242 to the API
2026-03-30 09:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:01:12Z',
 'fuel_type': 'diesel',
 'id': 'ef75bb0e-55cd-59d0-95f6-747aba4a0390',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC66242',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 120023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Business 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Business 4Motion BlueMotion',
 'year': 2020}
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC66242%27 HTTP/1.1" 200 None
2026-03-30 09:02:05 [auto1.it] INFO: Saving data for LC66242: {'auction_closing_time': 1774969272.0, 'created_time': 1773241891.958083, 'last_price_update_time': 1774861325.164855}
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC66242') HTTP/1.1" 204 0
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_d733648b6b8d6ef8babc9ca51c1c83a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_d733648b6b8d6ef8babc9ca51c1c83a2.jpg not downloaded yet
2026-03-30 09:02:05 [scrapy.extensions.logstats] INFO: Crawled 117 pages (at 53 pages/min), scraped 105 items (at 75 items/min)
2026-03-30 09:02:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 197MiB
2026-03-30 09:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a69af31-a41d-53a9-8556-085572af4916 with identifier: AE23716
2026-03-30 09:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a69af31-a41d-53a9-8556-085572af4916 with identifier: AE23716
2026-03-30 09:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a69af31-a41d-53a9-8556-085572af4916 with identifier: AE23716 to the API
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:02:31Z',
 'fuel_type': 'petrol',
 'id': '6a69af31-a41d-53a9-8556-085572af4916',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE23716',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 163101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-17',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2012}
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE23716%27 HTTP/1.1" 200 None
2026-03-30 09:02:05 [auto1.it] INFO: Saving data for AE23716: {'auction_closing_time': 1774969351.0, 'created_time': 1773414131.78322, 'last_price_update_time': 1774861325.574601}
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AE23716') HTTP/1.1" 204 0
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_fe51923a44fde04cf3d61b9d3180a88b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_fe51923a44fde04cf3d61b9d3180a88b.jpg not downloaded yet
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_3b19c169d5aa117118c1cfd5cf3f7458.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_3b19c169d5aa117118c1cfd5cf3f7458.jpg not downloaded yet
2026-03-30 09:02:05 [auto1.it] INFO: Found listing with ID: WX27288
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX27288%27 HTTP/1.1" 200 None
2026-03-30 09:02:05 [auto1.it] INFO: Scrape type for WX27288: 2
2026-03-30 09:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3dfd8e-ddeb-5138-a325-8f9ac829cff4 with identifier: WX27288
2026-03-30 09:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3dfd8e-ddeb-5138-a325-8f9ac829cff4 with scrape type 2
2026-03-30 09:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be3dfd8e-ddeb-5138-a325-8f9ac829cff4 with scrape type 2
2026-03-30 09:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be3dfd8e-ddeb-5138-a325-8f9ac829cff4, identifier: WX27288
2026-03-30 09:02:05 [auto1.it] INFO: Found listing with ID: ZZ91306
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ91306%27 HTTP/1.1" 200 None
2026-03-30 09:02:05 [auto1.it] INFO: Scrape type for ZZ91306: 2
2026-03-30 09:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3d84c93-00bf-52bc-94e2-fc391cc30753 with identifier: ZZ91306
2026-03-30 09:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3d84c93-00bf-52bc-94e2-fc391cc30753 with scrape type 2
2026-03-30 09:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3d84c93-00bf-52bc-94e2-fc391cc30753 with scrape type 2
2026-03-30 09:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b3d84c93-00bf-52bc-94e2-fc391cc30753, identifier: ZZ91306
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_89c6065d9cf2d1ca6c11caa769f4c0e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_89c6065d9cf2d1ca6c11caa769f4c0e2.jpg not downloaded yet
2026-03-30 09:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be3dfd8e-ddeb-5138-a325-8f9ac829cff4 with identifier: WX27288
2026-03-30 09:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be3dfd8e-ddeb-5138-a325-8f9ac829cff4 with identifier: WX27288
2026-03-30 09:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be3dfd8e-ddeb-5138-a325-8f9ac829cff4 with identifier: WX27288 to the API
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:38:16Z',
 'fuel_type': 'petrol',
 'id': 'be3dfd8e-ddeb-5138-a325-8f9ac829cff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX27288',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 26032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-28',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX27288%27 HTTP/1.1" 200 None
2026-03-30 09:02:06 [auto1.it] INFO: Saving data for WX27288: {'auction_closing_time': 1774971496.0, 'created_time': 1773910910.72841, 'last_price_update_time': 1774861326.262757}
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WX27288') HTTP/1.1" 204 0
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_4c2e77813a1ef0b7347bb33fbc801f1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_4c2e77813a1ef0b7347bb33fbc801f1b.jpg not downloaded yet
2026-03-30 09:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LH23516/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_18af8768db3c4b66470834474bb65a4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b3d84c93-00bf-52bc-94e2-fc391cc30753 with identifier: ZZ91306
2026-03-30 09:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b3d84c93-00bf-52bc-94e2-fc391cc30753 with identifier: ZZ91306
2026-03-30 09:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b3d84c93-00bf-52bc-94e2-fc391cc30753 with identifier: ZZ91306 to the API
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:52:44Z',
 'fuel_type': 'petrol',
 'id': 'b3d84c93-00bf-52bc-94e2-fc391cc30753',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ91306',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 216788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-21',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ91306%27 HTTP/1.1" 200 None
2026-03-30 09:02:06 [auto1.it] INFO: Saving data for ZZ91306: {'auction_closing_time': 1774972364.0, 'created_time': 1773134649.876093, 'last_price_update_time': 1774861326.667278}
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ91306') HTTP/1.1" 204 0
2026-03-30 09:02:06 [auto1.it] INFO: Found listing with ID: EY48329
2026-03-30 09:02:06 [auto1.it] INFO: Found listing with ID: FY08394
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY08394%27 HTTP/1.1" 200 None
2026-03-30 09:02:06 [auto1.it] INFO: Scrape type for FY08394: 2
2026-03-30 09:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7412241d-83eb-583b-9821-4727c0cd3bef with identifier: FY08394
2026-03-30 09:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7412241d-83eb-583b-9821-4727c0cd3bef with scrape type 2
2026-03-30 09:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7412241d-83eb-583b-9821-4727c0cd3bef with scrape type 2
2026-03-30 09:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7412241d-83eb-583b-9821-4727c0cd3bef, identifier: FY08394
2026-03-30 09:02:06 [auto1.it] INFO: Channel: 24h | Page: 9 | totalHits: 3287 | hits on page: 40
2026-03-30 09:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_e6b0f93a990b7562c0c4f768d4d29543.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:06 [auto1.it] INFO: Found listing with ID: FY27502
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY27502%27 HTTP/1.1" 200 None
2026-03-30 09:02:06 [auto1.it] INFO: Scrape type for FY27502: 2
2026-03-30 09:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f26ef558-6bee-5e95-8b8c-c3c9d930dda8 with identifier: FY27502
2026-03-30 09:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26ef558-6bee-5e95-8b8c-c3c9d930dda8 with scrape type 2
2026-03-30 09:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f26ef558-6bee-5e95-8b8c-c3c9d930dda8 with scrape type 2
2026-03-30 09:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f26ef558-6bee-5e95-8b8c-c3c9d930dda8, identifier: FY27502
2026-03-30 09:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7412241d-83eb-583b-9821-4727c0cd3bef with identifier: FY08394
2026-03-30 09:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7412241d-83eb-583b-9821-4727c0cd3bef with identifier: FY08394
2026-03-30 09:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7412241d-83eb-583b-9821-4727c0cd3bef with identifier: FY08394 to the API
2026-03-30 09:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-31T15:00:23Z',
 'fuel_type': 'petrol',
 'id': '7412241d-83eb-583b-9821-4727c0cd3bef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY08394',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 41021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-18',
 'seller_name': None,
 'title': 'Jeep Compass 1.5 GSE T4 e-Hybrid S FWD',
 'transmission': 'automatic',
 'trim': 'S FWD',
 'year': 2023}
2026-03-30 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY08394%27 HTTP/1.1" 200 None
2026-03-30 09:02:07 [auto1.it] INFO: Saving data for FY08394: {'auction_closing_time': 1774969223.0, 'created_time': 1773522058.13239, 'last_price_update_time': 1774861327.511432}
2026-03-30 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FY08394') HTTP/1.1" 204 0
2026-03-30 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_cad79db1cb48f4e2b82c57227ae5d18c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_cad79db1cb48f4e2b82c57227ae5d18c.jpg not downloaded yet
2026-03-30 09:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_a4716d668dc2de1072577912f425901c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f26ef558-6bee-5e95-8b8c-c3c9d930dda8 with identifier: FY27502
2026-03-30 09:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f26ef558-6bee-5e95-8b8c-c3c9d930dda8 with identifier: FY27502
2026-03-30 09:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f26ef558-6bee-5e95-8b8c-c3c9d930dda8 with identifier: FY27502 to the API
2026-03-30 09:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:10:41Z',
 'fuel_type': 'petrol',
 'id': 'f26ef558-6bee-5e95-8b8c-c3c9d930dda8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY27502',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 237991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-22',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Active 2WD',
 'transmission': 'manual',
 'trim': 'Active 2WD',
 'year': 2008}
2026-03-30 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY27502%27 HTTP/1.1" 200 None
2026-03-30 09:02:08 [auto1.it] INFO: Saving data for FY27502: {'auction_closing_time': 1774969841.0, 'created_time': 1773414111.644278, 'last_price_update_time': 1774861328.362815}
2026-03-30 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FY27502') HTTP/1.1" 204 0
2026-03-30 09:02:08 [auto1.it] INFO: Found listing with ID: RU39980
2026-03-30 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU39980%27 HTTP/1.1" 200 None
2026-03-30 09:02:08 [auto1.it] INFO: Scrape type for RU39980: 2
2026-03-30 09:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0571287e-a830-5fc2-b89d-f3c31f104f37 with identifier: RU39980
2026-03-30 09:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0571287e-a830-5fc2-b89d-f3c31f104f37 with scrape type 2
2026-03-30 09:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0571287e-a830-5fc2-b89d-f3c31f104f37 with scrape type 2
2026-03-30 09:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0571287e-a830-5fc2-b89d-f3c31f104f37, identifier: RU39980
2026-03-30 09:02:08 [auto1.it] INFO: Found listing with ID: PS15359
2026-03-30 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS15359%27 HTTP/1.1" 200 None
2026-03-30 09:02:08 [auto1.it] INFO: Scrape type for PS15359: 2
2026-03-30 09:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffb20e2f-e327-5b4a-9b92-3f476e3dba34 with identifier: PS15359
2026-03-30 09:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb20e2f-e327-5b4a-9b92-3f476e3dba34 with scrape type 2
2026-03-30 09:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffb20e2f-e327-5b4a-9b92-3f476e3dba34 with scrape type 2
2026-03-30 09:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ffb20e2f-e327-5b4a-9b92-3f476e3dba34, identifier: PS15359
2026-03-30 09:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_2d2190a1a9071d379ad1110b0ca03636.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0571287e-a830-5fc2-b89d-f3c31f104f37 with identifier: RU39980
2026-03-30 09:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0571287e-a830-5fc2-b89d-f3c31f104f37 with identifier: RU39980
2026-03-30 09:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0571287e-a830-5fc2-b89d-f3c31f104f37 with identifier: RU39980 to the API
2026-03-30 09:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:40:31Z',
 'fuel_type': 'hybrid',
 'id': '0571287e-a830-5fc2-b89d-f3c31f104f37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU39980',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'CT-Serie',
 'odometer': 143934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-10',
 'seller_name': None,
 'title': 'Lexus CT-Serie CT 200h Executive Line',
 'transmission': 'automatic',
 'trim': 'Executive Line',
 'year': 2014}
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU39980%27 HTTP/1.1" 200 None
2026-03-30 09:02:09 [auto1.it] INFO: Saving data for RU39980: {'auction_closing_time': 1774971631.0, 'created_time': 1774472805.578017, 'last_price_update_time': 1774861329.02567}
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RU39980') HTTP/1.1" 204 0
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_c4c25989b53d5c755d8360cbe9d89aab.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_c4c25989b53d5c755d8360cbe9d89aab.jpg not downloaded yet
2026-03-30 09:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ffb20e2f-e327-5b4a-9b92-3f476e3dba34 with identifier: PS15359
2026-03-30 09:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ffb20e2f-e327-5b4a-9b92-3f476e3dba34 with identifier: PS15359
2026-03-30 09:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ffb20e2f-e327-5b4a-9b92-3f476e3dba34 with identifier: PS15359 to the API
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:03:42Z',
 'fuel_type': 'diesel',
 'id': 'ffb20e2f-e327-5b4a-9b92-3f476e3dba34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS15359',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 157306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-06',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D4 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2018}
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS15359%27 HTTP/1.1" 200 None
2026-03-30 09:02:09 [auto1.it] INFO: Saving data for PS15359: {'auction_closing_time': 1774969422.0, 'created_time': 1774353797.140537, 'last_price_update_time': 1774861329.403983}
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PS15359') HTTP/1.1" 204 0
2026-03-30 09:02:09 [auto1.it] INFO: Found listing with ID: HW76597
2026-03-30 09:02:09 [auto1.it] INFO: Found listing with ID: BV54558
2026-03-30 09:02:09 [auto1.it] INFO: Found listing with ID: NL09316
2026-03-30 09:02:09 [auto1.it] INFO: Found listing with ID: AK10390
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK10390%27 HTTP/1.1" 200 None
2026-03-30 09:02:09 [auto1.it] INFO: Scrape type for AK10390: 2
2026-03-30 09:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f732d98c-2461-5a7a-84e0-bdba4d2395dc with identifier: AK10390
2026-03-30 09:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f732d98c-2461-5a7a-84e0-bdba4d2395dc with scrape type 2
2026-03-30 09:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f732d98c-2461-5a7a-84e0-bdba4d2395dc with scrape type 2
2026-03-30 09:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f732d98c-2461-5a7a-84e0-bdba4d2395dc, identifier: AK10390
2026-03-30 09:02:09 [auto1.it] INFO: Found listing with ID: LZ12908
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ12908%27 HTTP/1.1" 200 None
2026-03-30 09:02:09 [auto1.it] INFO: Scrape type for LZ12908: 2
2026-03-30 09:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 559bff03-982f-5b12-92ff-04b0060f0d19 with identifier: LZ12908
2026-03-30 09:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 559bff03-982f-5b12-92ff-04b0060f0d19 with scrape type 2
2026-03-30 09:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 559bff03-982f-5b12-92ff-04b0060f0d19 with scrape type 2
2026-03-30 09:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 559bff03-982f-5b12-92ff-04b0060f0d19, identifier: LZ12908
2026-03-30 09:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ea04d0>
2026-03-30 09:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_18af8768db3c4b66470834474bb65a4a.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_18af8768db3c4b66470834474bb65a4a.jpg saved to cache
2026-03-30 09:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 905b485c-0fa3-5fcf-9211-e634367836fb
2026-03-30 09:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06295f90>
2026-03-30 09:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_e6b0f93a990b7562c0c4f768d4d29543.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_e6b0f93a990b7562c0c4f768d4d29543.jpg saved to cache
2026-03-30 09:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d
2026-03-30 09:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f732d98c-2461-5a7a-84e0-bdba4d2395dc with identifier: AK10390
2026-03-30 09:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f732d98c-2461-5a7a-84e0-bdba4d2395dc with identifier: AK10390
2026-03-30 09:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f732d98c-2461-5a7a-84e0-bdba4d2395dc with identifier: AK10390 to the API
2026-03-30 09:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:33:24Z',
 'fuel_type': 'petrol',
 'id': 'f732d98c-2461-5a7a-84e0-bdba4d2395dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK10390',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 133995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-27',
 'seller_name': None,
 'title': 'Volvo V40 2.0 T2 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2019}
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK10390%27 HTTP/1.1" 200 None
2026-03-30 09:02:10 [auto1.it] INFO: Saving data for AK10390: {'auction_closing_time': 1774971204.0, 'created_time': 1774447250.777694, 'last_price_update_time': 1774861330.274952}
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AK10390') HTTP/1.1" 204 0
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_13b1fa4e4bb9301b72362e9032229a94.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_13b1fa4e4bb9301b72362e9032229a94.jpg not downloaded yet
2026-03-30 09:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 559bff03-982f-5b12-92ff-04b0060f0d19 with identifier: LZ12908
2026-03-30 09:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 559bff03-982f-5b12-92ff-04b0060f0d19 with identifier: LZ12908
2026-03-30 09:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 559bff03-982f-5b12-92ff-04b0060f0d19 with identifier: LZ12908 to the API
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:11:46Z',
 'fuel_type': 'diesel',
 'id': '559bff03-982f-5b12-92ff-04b0060f0d19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ12908',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 265731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-05',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Momentum Pro AWD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro AWD',
 'year': 2020}
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ12908%27 HTTP/1.1" 200 None
2026-03-30 09:02:10 [auto1.it] INFO: Saving data for LZ12908: {'auction_closing_time': 1774969906.0, 'created_time': 1773482612.325128, 'last_price_update_time': 1774861330.703285}
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LZ12908') HTTP/1.1" 204 0
2026-03-30 09:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fe5c90>
2026-03-30 09:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_a4716d668dc2de1072577912f425901c.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_a4716d668dc2de1072577912f425901c.jpg saved to cache
2026-03-30 09:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 905b485c-0fa3-5fcf-9211-e634367836fb
2026-03-30 09:02:10 [auto1.it] INFO: Found listing with ID: RU60792
2026-03-30 09:02:10 [auto1.it] INFO: Found listing with ID: KS82343
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS82343%27 HTTP/1.1" 200 None
2026-03-30 09:02:10 [auto1.it] INFO: Scrape type for KS82343: 2
2026-03-30 09:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78663a59-668c-5d5f-a4b9-d859050935f4 with identifier: KS82343
2026-03-30 09:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78663a59-668c-5d5f-a4b9-d859050935f4 with scrape type 2
2026-03-30 09:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78663a59-668c-5d5f-a4b9-d859050935f4 with scrape type 2
2026-03-30 09:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 78663a59-668c-5d5f-a4b9-d859050935f4, identifier: KS82343
2026-03-30 09:02:11 [auto1.it] INFO: Found listing with ID: CZ74992
2026-03-30 09:02:11 [auto1.it] INFO: Found listing with ID: SP98700
2026-03-30 09:02:11 [auto1.it] INFO: Found listing with ID: LW85334
2026-03-30 09:02:11 [auto1.it] INFO: Found listing with ID: WE89582
2026-03-30 09:02:11 [auto1.it] INFO: Found listing with ID: EA17133
2026-03-30 09:02:11 [auto1.it] INFO: Found listing with ID: LP18023
2026-03-30 09:02:11 [auto1.it] INFO: Found listing with ID: MZ33664
2026-03-30 09:02:11 [auto1.it] INFO: Found listing with ID: NL70600
2026-03-30 09:02:11 [auto1.it] INFO: Found listing with ID: YV46524
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV46524%27 HTTP/1.1" 200 None
2026-03-30 09:02:11 [auto1.it] INFO: Scrape type for YV46524: 2
2026-03-30 09:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 608d1a20-7a62-58d7-a3f1-312aa7b1a1d0 with identifier: YV46524
2026-03-30 09:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 608d1a20-7a62-58d7-a3f1-312aa7b1a1d0 with scrape type 2
2026-03-30 09:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 608d1a20-7a62-58d7-a3f1-312aa7b1a1d0 with scrape type 2
2026-03-30 09:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 608d1a20-7a62-58d7-a3f1-312aa7b1a1d0, identifier: YV46524
2026-03-30 09:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ea4a90>
2026-03-30 09:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_2d2190a1a9071d379ad1110b0ca03636.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_2d2190a1a9071d379ad1110b0ca03636.jpg saved to cache
2026-03-30 09:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d
2026-03-30 09:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_fd2a2e99ec2df0bbb72f1d78dca5b40f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 78663a59-668c-5d5f-a4b9-d859050935f4 with identifier: KS82343
2026-03-30 09:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 78663a59-668c-5d5f-a4b9-d859050935f4 with identifier: KS82343
2026-03-30 09:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 78663a59-668c-5d5f-a4b9-d859050935f4 with identifier: KS82343 to the API
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:27:00Z',
 'fuel_type': 'diesel',
 'id': '78663a59-668c-5d5f-a4b9-d859050935f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS82343',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 214120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-04',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS82343%27 HTTP/1.1" 200 None
2026-03-30 09:02:11 [auto1.it] INFO: Saving data for KS82343: {'auction_closing_time': 1774970820.0, 'created_time': 1774429227.06113, 'last_price_update_time': 1774861331.64579}
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KS82343') HTTP/1.1" 204 0
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_d57815c0ec8f01b2563392cd94d1b8a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_d57815c0ec8f01b2563392cd94d1b8a1.jpg not downloaded yet
2026-03-30 09:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 608d1a20-7a62-58d7-a3f1-312aa7b1a1d0 with identifier: YV46524
2026-03-30 09:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 608d1a20-7a62-58d7-a3f1-312aa7b1a1d0 with identifier: YV46524
2026-03-30 09:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 608d1a20-7a62-58d7-a3f1-312aa7b1a1d0 with identifier: YV46524 to the API
2026-03-30 09:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:02:51Z',
 'fuel_type': 'petrol',
 'id': '608d1a20-7a62-58d7-a3f1-312aa7b1a1d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV46524',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 86360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-16',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2017}
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV46524%27 HTTP/1.1" 200 None
2026-03-30 09:02:12 [auto1.it] INFO: Saving data for YV46524: {'auction_closing_time': 1774969371.0, 'created_time': 1774447233.087016, 'last_price_update_time': 1774861332.129698}
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YV46524') HTTP/1.1" 204 0
2026-03-30 09:02:12 [auto1.it] INFO: Found listing with ID: UK67498
2026-03-30 09:02:12 [auto1.it] INFO: Found listing with ID: XM02393
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM02393%27 HTTP/1.1" 200 None
2026-03-30 09:02:12 [auto1.it] INFO: Scrape type for XM02393: 2
2026-03-30 09:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b88b35c7-2f31-5a70-a01b-c1715b246fe1 with identifier: XM02393
2026-03-30 09:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b88b35c7-2f31-5a70-a01b-c1715b246fe1 with scrape type 2
2026-03-30 09:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b88b35c7-2f31-5a70-a01b-c1715b246fe1 with scrape type 2
2026-03-30 09:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b88b35c7-2f31-5a70-a01b-c1715b246fe1, identifier: XM02393
2026-03-30 09:02:12 [auto1.it] INFO: Found listing with ID: TN90495
2026-03-30 09:02:12 [auto1.it] INFO: Found listing with ID: AU20184
2026-03-30 09:02:12 [auto1.it] INFO: Found listing with ID: SK44334
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK44334%27 HTTP/1.1" 200 None
2026-03-30 09:02:12 [auto1.it] INFO: Scrape type for SK44334: 2
2026-03-30 09:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf with identifier: SK44334
2026-03-30 09:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf with scrape type 2
2026-03-30 09:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf with scrape type 2
2026-03-30 09:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf, identifier: SK44334
2026-03-30 09:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_67900bd255907cd4ee58a4f171f920dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b88b35c7-2f31-5a70-a01b-c1715b246fe1 with identifier: XM02393
2026-03-30 09:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b88b35c7-2f31-5a70-a01b-c1715b246fe1 with identifier: XM02393
2026-03-30 09:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b88b35c7-2f31-5a70-a01b-c1715b246fe1 with identifier: XM02393 to the API
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:49:30Z',
 'fuel_type': 'diesel',
 'id': 'b88b35c7-2f31-5a70-a01b-c1715b246fe1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM02393',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 199797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-01',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.3 JTD Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM02393%27 HTTP/1.1" 200 None
2026-03-30 09:02:12 [auto1.it] INFO: Saving data for XM02393: {'auction_closing_time': 1774972170.0, 'created_time': 1773759733.918321, 'last_price_update_time': 1774861332.816745}
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XM02393') HTTP/1.1" 204 0
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_5b5edfa4503f8fdc02256aa5d71c88ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_5b5edfa4503f8fdc02256aa5d71c88ce.jpg not downloaded yet
2026-03-30 09:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf with identifier: SK44334
2026-03-30 09:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf with identifier: SK44334
2026-03-30 09:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf with identifier: SK44334 to the API
2026-03-30 09:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:29:15Z',
 'fuel_type': 'diesel',
 'id': '2f114e7c-3914-5de5-a15c-0b1eb1e1f8bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK44334',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 174610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-09',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2019}
2026-03-30 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK44334%27 HTTP/1.1" 200 None
2026-03-30 09:02:13 [auto1.it] INFO: Saving data for SK44334: {'auction_closing_time': 1774970955.0, 'created_time': 1773675080.159461, 'last_price_update_time': 1774861333.265284}
2026-03-30 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK44334') HTTP/1.1" 204 0
2026-03-30 09:02:13 [auto1.it] INFO: Found listing with ID: BY67467
2026-03-30 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY67467%27 HTTP/1.1" 200 None
2026-03-30 09:02:13 [auto1.it] INFO: Scrape type for BY67467: 2
2026-03-30 09:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f57554e-f9e2-5316-bd39-d80b94cd68ac with identifier: BY67467
2026-03-30 09:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f57554e-f9e2-5316-bd39-d80b94cd68ac with scrape type 2
2026-03-30 09:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f57554e-f9e2-5316-bd39-d80b94cd68ac with scrape type 2
2026-03-30 09:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5f57554e-f9e2-5316-bd39-d80b94cd68ac, identifier: BY67467
2026-03-30 09:02:13 [auto1.it] INFO: Found listing with ID: JH80469
2026-03-30 09:02:13 [auto1.it] INFO: Found listing with ID: HZ78345
2026-03-30 09:02:13 [auto1.it] INFO: Found listing with ID: PK52051
2026-03-30 09:02:13 [auto1.it] INFO: Found listing with ID: TE89660
2026-03-30 09:02:13 [auto1.it] INFO: Found listing with ID: UB72934
2026-03-30 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB72934%27 HTTP/1.1" 200 None
2026-03-30 09:02:13 [auto1.it] INFO: Scrape type for UB72934: 2
2026-03-30 09:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74cdd273-9904-577b-9c73-e96c9b788d5b with identifier: UB72934
2026-03-30 09:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74cdd273-9904-577b-9c73-e96c9b788d5b with scrape type 2
2026-03-30 09:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74cdd273-9904-577b-9c73-e96c9b788d5b with scrape type 2
2026-03-30 09:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 74cdd273-9904-577b-9c73-e96c9b788d5b, identifier: UB72934
2026-03-30 09:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_f1fa1b174f55150a67f5821e78009314.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5f57554e-f9e2-5316-bd39-d80b94cd68ac with identifier: BY67467
2026-03-30 09:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5f57554e-f9e2-5316-bd39-d80b94cd68ac with identifier: BY67467
2026-03-30 09:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5f57554e-f9e2-5316-bd39-d80b94cd68ac with identifier: BY67467 to the API
2026-03-30 09:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:53:10Z',
 'fuel_type': 'petrol',
 'id': '5f57554e-f9e2-5316-bd39-d80b94cd68ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY67467',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 42157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-27',
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-30 09:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY67467%27 HTTP/1.1" 200 None
2026-03-30 09:02:14 [auto1.it] INFO: Saving data for BY67467: {'auction_closing_time': 1774972390.0, 'created_time': 1773232852.728676, 'last_price_update_time': 1774861334.003585}
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BY67467') HTTP/1.1" 204 0
2026-03-30 09:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 74cdd273-9904-577b-9c73-e96c9b788d5b with identifier: UB72934
2026-03-30 09:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 74cdd273-9904-577b-9c73-e96c9b788d5b with identifier: UB72934
2026-03-30 09:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 74cdd273-9904-577b-9c73-e96c9b788d5b with identifier: UB72934 to the API
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-31T15:49:57Z',
 'fuel_type': 'petrol',
 'id': '74cdd273-9904-577b-9c73-e96c9b788d5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB72934',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 36664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-28',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Journey',
 'transmission': 'automatic',
 'trim': 'Journey',
 'year': 2024}
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB72934%27 HTTP/1.1" 200 None
2026-03-30 09:02:14 [auto1.it] INFO: Saving data for UB72934: {'auction_closing_time': 1774972197.0, 'created_time': 1773954057.830915, 'last_price_update_time': 1774861334.51637}
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB72934') HTTP/1.1" 204 0
2026-03-30 09:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f49010>
2026-03-30 09:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_fd2a2e99ec2df0bbb72f1d78dca5b40f.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_fd2a2e99ec2df0bbb72f1d78dca5b40f.jpg saved to cache
2026-03-30 09:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205
2026-03-30 09:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_bde3522ddb284bf85fcc11010e19bb2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:14 [auto1.it] INFO: Found listing with ID: GZ67073
2026-03-30 09:02:14 [auto1.it] INFO: Found listing with ID: CH55121
2026-03-30 09:02:14 [auto1.it] INFO: Found listing with ID: WU93186
2026-03-30 09:02:14 [auto1.it] INFO: Found listing with ID: SH29358
2026-03-30 09:02:14 [auto1.it] INFO: Found listing with ID: NK12319
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK12319%27 HTTP/1.1" 200 None
2026-03-30 09:02:14 [auto1.it] INFO: Scrape type for NK12319: 2
2026-03-30 09:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ede521e0-04fe-59ba-ac32-d9058db689ff with identifier: NK12319
2026-03-30 09:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede521e0-04fe-59ba-ac32-d9058db689ff with scrape type 2
2026-03-30 09:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ede521e0-04fe-59ba-ac32-d9058db689ff with scrape type 2
2026-03-30 09:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ede521e0-04fe-59ba-ac32-d9058db689ff, identifier: NK12319
2026-03-30 09:02:14 [auto1.it] INFO: Found listing with ID: RB69324
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB69324%27 HTTP/1.1" 200 None
2026-03-30 09:02:14 [auto1.it] INFO: Scrape type for RB69324: 2
2026-03-30 09:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 164e2e89-1934-5c6e-a515-7257a8a4744b with identifier: RB69324
2026-03-30 09:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 164e2e89-1934-5c6e-a515-7257a8a4744b with scrape type 2
2026-03-30 09:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 164e2e89-1934-5c6e-a515-7257a8a4744b with scrape type 2
2026-03-30 09:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 164e2e89-1934-5c6e-a515-7257a8a4744b, identifier: RB69324
2026-03-30 09:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_f404d9c64ff718b6e61e388ce4d364c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ede521e0-04fe-59ba-ac32-d9058db689ff with identifier: NK12319
2026-03-30 09:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ede521e0-04fe-59ba-ac32-d9058db689ff with identifier: NK12319
2026-03-30 09:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ede521e0-04fe-59ba-ac32-d9058db689ff with identifier: NK12319 to the API
2026-03-30 09:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:24:47Z',
 'fuel_type': 'diesel',
 'id': 'ede521e0-04fe-59ba-ac32-d9058db689ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK12319',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 83186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-21',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK12319%27 HTTP/1.1" 200 None
2026-03-30 09:02:15 [auto1.it] INFO: Saving data for NK12319: {'auction_closing_time': 1774970687.0, 'created_time': 1774472744.037882, 'last_price_update_time': 1774861335.247828}
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NK12319') HTTP/1.1" 204 0
2026-03-30 09:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 164e2e89-1934-5c6e-a515-7257a8a4744b with identifier: RB69324
2026-03-30 09:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 164e2e89-1934-5c6e-a515-7257a8a4744b with identifier: RB69324
2026-03-30 09:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 164e2e89-1934-5c6e-a515-7257a8a4744b with identifier: RB69324 to the API
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:28:39Z',
 'fuel_type': 'diesel',
 'id': '164e2e89-1934-5c6e-a515-7257a8a4744b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB69324',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 89358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-05',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB69324%27 HTTP/1.1" 200 None
2026-03-30 09:02:15 [auto1.it] INFO: Saving data for RB69324: {'auction_closing_time': 1774970919.0, 'created_time': 1774386214.852747, 'last_price_update_time': 1774861335.590275}
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RB69324') HTTP/1.1" 204 0
2026-03-30 09:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c91110>
2026-03-30 09:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_67900bd255907cd4ee58a4f171f920dc.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_67900bd255907cd4ee58a4f171f920dc.jpg saved to cache
2026-03-30 09:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 905b485c-0fa3-5fcf-9211-e634367836fb
2026-03-30 09:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_212057072b0dc99954759f5491359aa9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:15 [auto1.it] INFO: Found listing with ID: VY18812
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY18812%27 HTTP/1.1" 200 None
2026-03-30 09:02:15 [auto1.it] INFO: Scrape type for VY18812: 2
2026-03-30 09:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3375c430-c5aa-5bc6-b056-c4c58fbe23a3 with identifier: VY18812
2026-03-30 09:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3375c430-c5aa-5bc6-b056-c4c58fbe23a3 with scrape type 2
2026-03-30 09:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3375c430-c5aa-5bc6-b056-c4c58fbe23a3 with scrape type 2
2026-03-30 09:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3375c430-c5aa-5bc6-b056-c4c58fbe23a3, identifier: VY18812
2026-03-30 09:02:15 [auto1.it] INFO: Found listing with ID: PN79982
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN79982%27 HTTP/1.1" 200 None
2026-03-30 09:02:15 [auto1.it] INFO: Scrape type for PN79982: 2
2026-03-30 09:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 689661dd-97e0-5cfe-9bdf-e6aa13df4064 with identifier: PN79982
2026-03-30 09:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689661dd-97e0-5cfe-9bdf-e6aa13df4064 with scrape type 2
2026-03-30 09:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 689661dd-97e0-5cfe-9bdf-e6aa13df4064 with scrape type 2
2026-03-30 09:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 689661dd-97e0-5cfe-9bdf-e6aa13df4064, identifier: PN79982
2026-03-30 09:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3375c430-c5aa-5bc6-b056-c4c58fbe23a3 with identifier: VY18812
2026-03-30 09:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3375c430-c5aa-5bc6-b056-c4c58fbe23a3 with identifier: VY18812
2026-03-30 09:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3375c430-c5aa-5bc6-b056-c4c58fbe23a3 with identifier: VY18812 to the API
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:45:30Z',
 'fuel_type': 'diesel',
 'id': '3375c430-c5aa-5bc6-b056-c4c58fbe23a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY18812',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 240607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI GTD',
 'transmission': 'manual',
 'trim': 'GTD',
 'year': 2011}
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY18812%27 HTTP/1.1" 200 None
2026-03-30 09:02:16 [auto1.it] INFO: Saving data for VY18812: {'auction_closing_time': 1774971930.0, 'created_time': 1773954063.281626, 'last_price_update_time': 1774861336.517544}
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY18812') HTTP/1.1" 204 0
2026-03-30 09:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 689661dd-97e0-5cfe-9bdf-e6aa13df4064 with identifier: PN79982
2026-03-30 09:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 689661dd-97e0-5cfe-9bdf-e6aa13df4064 with identifier: PN79982
2026-03-30 09:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 689661dd-97e0-5cfe-9bdf-e6aa13df4064 with identifier: PN79982 to the API
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-31T15:16:05Z',
 'fuel_type': 'diesel',
 'id': '689661dd-97e0-5cfe-9bdf-e6aa13df4064',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN79982',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 189410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-22',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 V6 TDI HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2015}
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN79982%27 HTTP/1.1" 200 None
2026-03-30 09:02:16 [auto1.it] INFO: Saving data for PN79982: {'auction_closing_time': 1774970165.0, 'created_time': 1774472426.951446, 'last_price_update_time': 1774861336.898024}
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PN79982') HTTP/1.1" 204 0
2026-03-30 09:02:16 [auto1.it] INFO: Found listing with ID: EZ69739
2026-03-30 09:02:16 [auto1.it] INFO: Found listing with ID: ZX52658
2026-03-30 09:02:16 [auto1.it] INFO: Found listing with ID: LY23963
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY23963%27 HTTP/1.1" 200 None
2026-03-30 09:02:16 [auto1.it] INFO: Scrape type for LY23963: 2
2026-03-30 09:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed120ccc-b6f9-5e40-896b-649269cbb667 with identifier: LY23963
2026-03-30 09:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed120ccc-b6f9-5e40-896b-649269cbb667 with scrape type 2
2026-03-30 09:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed120ccc-b6f9-5e40-896b-649269cbb667 with scrape type 2
2026-03-30 09:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ed120ccc-b6f9-5e40-896b-649269cbb667, identifier: LY23963
2026-03-30 09:02:17 [auto1.it] INFO: Found listing with ID: YT69462
2026-03-30 09:02:17 [auto1.it] INFO: Found listing with ID: ZZ84450
2026-03-30 09:02:17 [auto1.it] INFO: Found listing with ID: JA78037
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA78037%27 HTTP/1.1" 200 None
2026-03-30 09:02:17 [auto1.it] INFO: Scrape type for JA78037: 2
2026-03-30 09:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5a54253-fa78-516e-b295-0c1cfd51d367 with identifier: JA78037
2026-03-30 09:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5a54253-fa78-516e-b295-0c1cfd51d367 with scrape type 2
2026-03-30 09:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5a54253-fa78-516e-b295-0c1cfd51d367 with scrape type 2
2026-03-30 09:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e5a54253-fa78-516e-b295-0c1cfd51d367, identifier: JA78037
2026-03-30 09:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061ca850>
2026-03-30 09:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_f1fa1b174f55150a67f5821e78009314.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_f1fa1b174f55150a67f5821e78009314.jpg saved to cache
2026-03-30 09:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d
2026-03-30 09:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061a0d90>
2026-03-30 09:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_bde3522ddb284bf85fcc11010e19bb2b.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_bde3522ddb284bf85fcc11010e19bb2b.jpg saved to cache
2026-03-30 09:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b
2026-03-30 09:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0639ad10>
2026-03-30 09:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_f404d9c64ff718b6e61e388ce4d364c4.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_f404d9c64ff718b6e61e388ce4d364c4.jpg saved to cache
2026-03-30 09:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d
2026-03-30 09:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_cad79db1cb48f4e2b82c57227ae5d18c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_fe51923a44fde04cf3d61b9d3180a88b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ed120ccc-b6f9-5e40-896b-649269cbb667 with identifier: LY23963
2026-03-30 09:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ed120ccc-b6f9-5e40-896b-649269cbb667 with identifier: LY23963
2026-03-30 09:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ed120ccc-b6f9-5e40-896b-649269cbb667 with identifier: LY23963 to the API
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:51:07Z',
 'fuel_type': 'diesel',
 'id': 'ed120ccc-b6f9-5e40-896b-649269cbb667',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY23963',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 110058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-14',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY23963%27 HTTP/1.1" 200 None
2026-03-30 09:02:17 [auto1.it] INFO: Saving data for LY23963: {'auction_closing_time': 1774972267.0, 'created_time': 1773231606.200454, 'last_price_update_time': 1774861337.794804}
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LY23963') HTTP/1.1" 204 0
2026-03-30 09:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e5a54253-fa78-516e-b295-0c1cfd51d367 with identifier: JA78037
2026-03-30 09:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e5a54253-fa78-516e-b295-0c1cfd51d367 with identifier: JA78037
2026-03-30 09:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e5a54253-fa78-516e-b295-0c1cfd51d367 with identifier: JA78037 to the API
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:51:48Z',
 'fuel_type': 'petrol',
 'id': 'e5a54253-fa78-516e-b295-0c1cfd51d367',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA78037',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 23236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-08',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2009}
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA78037%27 HTTP/1.1" 200 None
2026-03-30 09:02:18 [auto1.it] INFO: Saving data for JA78037: {'auction_closing_time': 1774972308.0, 'created_time': 1773269854.257132, 'last_price_update_time': 1774861338.252078}
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JA78037') HTTP/1.1" 204 0
2026-03-30 09:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_99167cf3aed27f026c4d847bc2640016.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_26256165a0fea9aa78b1e6934e0b3133.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:18 [auto1.it] INFO: Found listing with ID: KC02263
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC02263%27 HTTP/1.1" 200 None
2026-03-30 09:02:18 [auto1.it] INFO: Scrape type for KC02263: 2
2026-03-30 09:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1e8b51d-9cf5-5345-8f5e-dd7b489030c9 with identifier: KC02263
2026-03-30 09:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e8b51d-9cf5-5345-8f5e-dd7b489030c9 with scrape type 2
2026-03-30 09:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1e8b51d-9cf5-5345-8f5e-dd7b489030c9 with scrape type 2
2026-03-30 09:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f1e8b51d-9cf5-5345-8f5e-dd7b489030c9, identifier: KC02263
2026-03-30 09:02:18 [auto1.it] INFO: Found listing with ID: PY49742
2026-03-30 09:02:18 [auto1.it] INFO: Found listing with ID: JH99386
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH99386%27 HTTP/1.1" 200 None
2026-03-30 09:02:18 [auto1.it] INFO: Scrape type for JH99386: 2
2026-03-30 09:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f5c330-69da-566b-9255-e02f2bc90935 with identifier: JH99386
2026-03-30 09:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f5c330-69da-566b-9255-e02f2bc90935 with scrape type 2
2026-03-30 09:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6f5c330-69da-566b-9255-e02f2bc90935 with scrape type 2
2026-03-30 09:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c6f5c330-69da-566b-9255-e02f2bc90935, identifier: JH99386
2026-03-30 09:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f1e8b51d-9cf5-5345-8f5e-dd7b489030c9 with identifier: KC02263
2026-03-30 09:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f1e8b51d-9cf5-5345-8f5e-dd7b489030c9 with identifier: KC02263
2026-03-30 09:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f1e8b51d-9cf5-5345-8f5e-dd7b489030c9 with identifier: KC02263 to the API
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:51:10Z',
 'fuel_type': 'petrol',
 'id': 'f1e8b51d-9cf5-5345-8f5e-dd7b489030c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC02263',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 48324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-13',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC02263%27 HTTP/1.1" 200 None
2026-03-30 09:02:18 [auto1.it] INFO: Saving data for KC02263: {'auction_closing_time': 1774972270.0, 'created_time': 1774440098.29024, 'last_price_update_time': 1774861338.895648}
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC02263') HTTP/1.1" 204 0
2026-03-30 09:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c6f5c330-69da-566b-9255-e02f2bc90935 with identifier: JH99386
2026-03-30 09:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c6f5c330-69da-566b-9255-e02f2bc90935 with identifier: JH99386
2026-03-30 09:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c6f5c330-69da-566b-9255-e02f2bc90935 with identifier: JH99386 to the API
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:31:07Z',
 'fuel_type': 'gas',
 'id': 'c6f5c330-69da-566b-9255-e02f2bc90935',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH99386',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 311737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-27',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI EcoFuel Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH99386%27 HTTP/1.1" 200 None
2026-03-30 09:02:19 [auto1.it] INFO: Saving data for JH99386: {'auction_closing_time': 1774971067.0, 'created_time': 1773267279.179868, 'last_price_update_time': 1774861339.27286}
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JH99386') HTTP/1.1" 204 0
2026-03-30 09:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dc5dd0>
2026-03-30 09:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_212057072b0dc99954759f5491359aa9.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_212057072b0dc99954759f5491359aa9.jpg saved to cache
2026-03-30 09:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b
2026-03-30 09:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_d0dcffb6990941680fed2cf21c224004.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_d57815c0ec8f01b2563392cd94d1b8a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_13b1fa4e4bb9301b72362e9032229a94.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:19 [auto1.it] INFO: Found listing with ID: YZ93914
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ93914%27 HTTP/1.1" 200 None
2026-03-30 09:02:19 [auto1.it] INFO: Scrape type for YZ93914: 2
2026-03-30 09:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 627f96a6-41c8-5896-87be-ebfa82537921 with identifier: YZ93914
2026-03-30 09:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 627f96a6-41c8-5896-87be-ebfa82537921 with scrape type 2
2026-03-30 09:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 627f96a6-41c8-5896-87be-ebfa82537921 with scrape type 2
2026-03-30 09:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 627f96a6-41c8-5896-87be-ebfa82537921, identifier: YZ93914
2026-03-30 09:02:19 [auto1.it] INFO: Found listing with ID: AS63224
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS63224%27 HTTP/1.1" 200 None
2026-03-30 09:02:19 [auto1.it] INFO: Scrape type for AS63224: 2
2026-03-30 09:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a39238e2-678d-5fb7-8c75-4b7105fa2e12 with identifier: AS63224
2026-03-30 09:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a39238e2-678d-5fb7-8c75-4b7105fa2e12 with scrape type 2
2026-03-30 09:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a39238e2-678d-5fb7-8c75-4b7105fa2e12 with scrape type 2
2026-03-30 09:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a39238e2-678d-5fb7-8c75-4b7105fa2e12, identifier: AS63224
2026-03-30 09:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ03272> (referer: https://www.auto1.com/v1/car-details-view/LJ03272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 627f96a6-41c8-5896-87be-ebfa82537921 with identifier: YZ93914
2026-03-30 09:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 627f96a6-41c8-5896-87be-ebfa82537921 with identifier: YZ93914
2026-03-30 09:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 627f96a6-41c8-5896-87be-ebfa82537921 with identifier: YZ93914 to the API
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:13:37Z',
 'fuel_type': 'diesel',
 'id': '627f96a6-41c8-5896-87be-ebfa82537921',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ93914',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 178230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-09',
 'seller_name': None,
 'title': 'Renault Laguna 1.5 dCi Black Edition',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2011}
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ93914%27 HTTP/1.1" 200 None
2026-03-30 09:02:20 [auto1.it] INFO: Saving data for YZ93914: {'auction_closing_time': 1774970017.0, 'created_time': 1774386319.423358, 'last_price_update_time': 1774861340.064971}
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YZ93914') HTTP/1.1" 204 0
2026-03-30 09:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a39238e2-678d-5fb7-8c75-4b7105fa2e12 with identifier: AS63224
2026-03-30 09:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a39238e2-678d-5fb7-8c75-4b7105fa2e12 with identifier: AS63224
2026-03-30 09:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a39238e2-678d-5fb7-8c75-4b7105fa2e12 with identifier: AS63224 to the API
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:02:43Z',
 'fuel_type': 'diesel',
 'id': 'a39238e2-678d-5fb7-8c75-4b7105fa2e12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS63224',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 145060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-24',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2017}
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS63224%27 HTTP/1.1" 200 None
2026-03-30 09:02:20 [auto1.it] INFO: Saving data for AS63224: {'auction_closing_time': 1774969363.0, 'created_time': 1773922557.877052, 'last_price_update_time': 1774861340.467002}
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AS63224') HTTP/1.1" 204 0
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ceb690>
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_cad79db1cb48f4e2b82c57227ae5d18c.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_cad79db1cb48f4e2b82c57227ae5d18c.jpg saved to cache
2026-03-30 09:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fdc75bcf-2509-5b37-a792-79e28573db64
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cb8710>
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_fe51923a44fde04cf3d61b9d3180a88b.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_fe51923a44fde04cf3d61b9d3180a88b.jpg saved to cache
2026-03-30 09:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205
2026-03-30 09:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f5b850>
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F81%252Fec81246fc281e678044b5ac05fd24d0e%252Fpa%252FZH19388_99167cf3aed27f026c4d847bc2640016.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_99167cf3aed27f026c4d847bc2640016.jpg saved to cache
2026-03-30 09:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b
2026-03-30 09:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88d77b50-9bcf-5f02-85c3-59ee5e61c74b, skipping ID generation
2026-03-30 09:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b with scrape type 1
2026-03-30 09:02:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88d77b50-9bcf-5f02-85c3-59ee5e61c74b sending to next pipeline
2026-03-30 09:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 88d77b50-9bcf-5f02-85c3-59ee5e61c74b, identifier: ZH19388
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061c0490>
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_26256165a0fea9aa78b1e6934e0b3133.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_26256165a0fea9aa78b1e6934e0b3133.jpg saved to cache
2026-03-30 09:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 905b485c-0fa3-5fcf-9211-e634367836fb
2026-03-30 09:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_5b5edfa4503f8fdc02256aa5d71c88ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_c4c25989b53d5c755d8360cbe9d89aab.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:20 [auto1.it] INFO: Found listing with ID: VR96583
2026-03-30 09:02:20 [auto1.it] INFO: Found listing with ID: GT94067
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT94067%27 HTTP/1.1" 200 None
2026-03-30 09:02:20 [auto1.it] INFO: Scrape type for GT94067: 2
2026-03-30 09:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eda24e9-8fa4-5e1f-8592-f761eb94545b with identifier: GT94067
2026-03-30 09:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eda24e9-8fa4-5e1f-8592-f761eb94545b with scrape type 2
2026-03-30 09:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eda24e9-8fa4-5e1f-8592-f761eb94545b with scrape type 2
2026-03-30 09:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6eda24e9-8fa4-5e1f-8592-f761eb94545b, identifier: GT94067
2026-03-30 09:02:21 [auto1.it] INFO: Found listing with ID: AA10664
2026-03-30 09:02:21 [auto1.it] INFO: Found listing with ID: AM15207
2026-03-30 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM15207%27 HTTP/1.1" 200 None
2026-03-30 09:02:21 [auto1.it] INFO: Scrape type for AM15207: 2
2026-03-30 09:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5937f75a-9613-52c0-b46e-47b1a2433664 with identifier: AM15207
2026-03-30 09:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5937f75a-9613-52c0-b46e-47b1a2433664 with scrape type 2
2026-03-30 09:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5937f75a-9613-52c0-b46e-47b1a2433664 with scrape type 2
2026-03-30 09:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5937f75a-9613-52c0-b46e-47b1a2433664, identifier: AM15207
2026-03-30 09:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 88d77b50-9bcf-5f02-85c3-59ee5e61c74b with identifier: ZH19388
2026-03-30 09:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 88d77b50-9bcf-5f02-85c3-59ee5e61c74b with identifier: ZH19388
2026-03-30 09:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 88d77b50-9bcf-5f02-85c3-59ee5e61c74b with identifier: ZH19388 to the API
2026-03-30 09:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_99167cf3aed27f026c4d847bc2640016.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:47:59Z',
 'fuel_type': 'petrol',
 'id': '88d77b50-9bcf-5f02-85c3-59ee5e61c74b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH19388',
 'listing': 'auction',
 'location': "IT, Gradisca d'Isonzo",
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 84503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2208275,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_99167cf3aed27f026c4d847bc2640016.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2118024,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_1efa4ee5011c0686158033e44b1cc722.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2093863,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_212057072b0dc99954759f5491359aa9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1956194,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_eff7e7e72c48df04bb82a17b7fdfcecc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2029546,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_bde3522ddb284bf85fcc11010e19bb2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2049552,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_52b7b6e9c86f371f9cb8ccdf16c726e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1924948,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_bc6907aa1884cfb235e6b86d0e549e48.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2112632,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_bb1f2f7f7b6d8882fefda38f3154fc2d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2119320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_0bba5000217435d99236a965f6be0b50.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88d77b50-9bcf-5f02-85c3-59ee5e61c74b/88d77b50-9bcf-5f02-85c3-59ee5e61c74b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2091415,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/81/ec81246fc281e678044b5ac05fd24d0e/pa/ZH19388_66c81dda243d5759fc56a61e42a4cf58.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2023}
2026-03-30 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH19388%27 HTTP/1.1" 200 None
2026-03-30 09:02:21 [auto1.it] INFO: Saving data for ZH19388: {'created_time': 1774861341.648703, 'last_price_update_time': 1774861341.648716, 'auction_closing_time': 1774972079.0}
2026-03-30 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH19388') HTTP/1.1" 204 0
2026-03-30 09:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_e27067b30cec58215e5c2ceb3ad3406b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6eda24e9-8fa4-5e1f-8592-f761eb94545b with identifier: GT94067
2026-03-30 09:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6eda24e9-8fa4-5e1f-8592-f761eb94545b with identifier: GT94067
2026-03-30 09:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6eda24e9-8fa4-5e1f-8592-f761eb94545b with identifier: GT94067 to the API
2026-03-30 09:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:13:32Z',
 'fuel_type': 'diesel',
 'id': '6eda24e9-8fa4-5e1f-8592-f761eb94545b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT94067',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 100115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-30',
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Trailhawk 4WD',
 'transmission': 'automatic',
 'trim': 'Trailhawk 4WD',
 'year': 2018}
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT94067%27 HTTP/1.1" 200 None
2026-03-30 09:02:22 [auto1.it] INFO: Saving data for GT94067: {'auction_closing_time': 1774970012.0, 'created_time': 1774015494.565797, 'last_price_update_time': 1774861342.06778}
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GT94067') HTTP/1.1" 204 0
2026-03-30 09:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5937f75a-9613-52c0-b46e-47b1a2433664 with identifier: AM15207
2026-03-30 09:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5937f75a-9613-52c0-b46e-47b1a2433664 with identifier: AM15207
2026-03-30 09:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5937f75a-9613-52c0-b46e-47b1a2433664 with identifier: AM15207 to the API
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:52:42Z',
 'fuel_type': 'petrol',
 'id': '5937f75a-9613-52c0-b46e-47b1a2433664',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM15207',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 24671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-26',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Monte Carlo',
 'transmission': 'manual',
 'trim': 'Monte Carlo',
 'year': 2022}
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM15207%27 HTTP/1.1" 200 None
2026-03-30 09:02:22 [auto1.it] INFO: Saving data for AM15207: {'auction_closing_time': 1774972362.0, 'created_time': 1774472750.253455, 'last_price_update_time': 1774861342.430695}
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AM15207') HTTP/1.1" 204 0
2026-03-30 09:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-03-30 09:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-03-30 09:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 09:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-03-30 09:02:22 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:03:27 12:40:09\x00'
2026-03-30 09:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-03-30 09:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061e06d0>
2026-03-30 09:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_d0dcffb6990941680fed2cf21c224004.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_d0dcffb6990941680fed2cf21c224004.jpg saved to cache
2026-03-30 09:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d
2026-03-30 09:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e7bb50>
2026-03-30 09:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_d57815c0ec8f01b2563392cd94d1b8a1.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_d57815c0ec8f01b2563392cd94d1b8a1.jpg saved to cache
2026-03-30 09:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fdc75bcf-2509-5b37-a792-79e28573db64
2026-03-30 09:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0cd84250>
2026-03-30 09:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_13b1fa4e4bb9301b72362e9032229a94.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_13b1fa4e4bb9301b72362e9032229a94.jpg saved to cache
2026-03-30 09:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fdc75bcf-2509-5b37-a792-79e28573db64
2026-03-30 09:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_05deff3d6bba88f307db676da6db3f2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:22 [auto1.it] INFO: Found listing with ID: PK23396
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK23396%27 HTTP/1.1" 200 None
2026-03-30 09:02:22 [auto1.it] INFO: Scrape type for PK23396: 2
2026-03-30 09:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bc4d0c4-150c-56d8-886a-829beafb7645 with identifier: PK23396
2026-03-30 09:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bc4d0c4-150c-56d8-886a-829beafb7645 with scrape type 2
2026-03-30 09:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bc4d0c4-150c-56d8-886a-829beafb7645 with scrape type 2
2026-03-30 09:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5bc4d0c4-150c-56d8-886a-829beafb7645, identifier: PK23396
2026-03-30 09:02:22 [auto1.it] INFO: Found listing with ID: WS56661
2026-03-30 09:02:22 [auto1.it] INFO: Found listing with ID: EU06548
2026-03-30 09:02:22 [auto1.it] INFO: Found listing with ID: NR20429
2026-03-30 09:02:22 [auto1.it] INFO: Found listing with ID: YJ46375
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ46375%27 HTTP/1.1" 200 None
2026-03-30 09:02:22 [auto1.it] INFO: Scrape type for YJ46375: 2
2026-03-30 09:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4c2fadc-4443-5693-b640-0322cb45b9a3 with identifier: YJ46375
2026-03-30 09:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4c2fadc-4443-5693-b640-0322cb45b9a3 with scrape type 2
2026-03-30 09:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4c2fadc-4443-5693-b640-0322cb45b9a3 with scrape type 2
2026-03-30 09:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4c2fadc-4443-5693-b640-0322cb45b9a3, identifier: YJ46375
2026-03-30 09:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LH23516> (referer: https://www.auto1.com/v1/car-details-view/LH23516/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5bc4d0c4-150c-56d8-886a-829beafb7645 with identifier: PK23396
2026-03-30 09:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5bc4d0c4-150c-56d8-886a-829beafb7645 with identifier: PK23396
2026-03-30 09:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5bc4d0c4-150c-56d8-886a-829beafb7645 with identifier: PK23396 to the API
2026-03-30 09:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:18:41Z',
 'fuel_type': 'diesel',
 'id': '5bc4d0c4-150c-56d8-886a-829beafb7645',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK23396',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 274446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-04',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 TD V6 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2010}
2026-03-30 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK23396%27 HTTP/1.1" 200 None
2026-03-30 09:02:23 [auto1.it] INFO: Saving data for PK23396: {'auction_closing_time': 1774970321.0, 'created_time': 1773327908.92519, 'last_price_update_time': 1774861343.229403}
2026-03-30 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PK23396') HTTP/1.1" 204 0
2026-03-30 09:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4c2fadc-4443-5693-b640-0322cb45b9a3 with identifier: YJ46375
2026-03-30 09:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4c2fadc-4443-5693-b640-0322cb45b9a3 with identifier: YJ46375
2026-03-30 09:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4c2fadc-4443-5693-b640-0322cb45b9a3 with identifier: YJ46375 to the API
2026-03-30 09:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:47:41Z',
 'fuel_type': 'petrol',
 'id': 'b4c2fadc-4443-5693-b640-0322cb45b9a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ46375',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 136468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-28',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive pulse',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive pulse',
 'year': 2012}
2026-03-30 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ46375%27 HTTP/1.1" 200 None
2026-03-30 09:02:23 [auto1.it] INFO: Saving data for YJ46375: {'auction_closing_time': 1774972061.0, 'created_time': 1774440161.337272, 'last_price_update_time': 1774861343.976605}
2026-03-30 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YJ46375') HTTP/1.1" 204 0
2026-03-30 09:02:24 [auto1.it] INFO: Channel: 24h | Page: 10 | totalHits: 3288 | hits on page: 40
2026-03-30 09:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5edea1ad-e110-5136-811c-dec155757da3 with identifier: LJ03272
2026-03-30 09:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5edea1ad-e110-5136-811c-dec155757da3 with scrape type 1
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5edea1ad-e110-5136-811c-dec155757da3
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F62%252Fef6216c7f3c199a2385555c43eca16b9%252Fpa%252FLJ03272_29f66177825ed8ff618fbf9e5aebab2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_29f66177825ed8ff618fbf9e5aebab2e.jpg already downloaded
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F62%252Fef6216c7f3c199a2385555c43eca16b9%252Fpa%252FLJ03272_3373162eb64e6a7877b8f7a9f625823e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_3373162eb64e6a7877b8f7a9f625823e.jpg already downloaded
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F62%252Fef6216c7f3c199a2385555c43eca16b9%252Fpa%252FLJ03272_24dae183fc8213411602920eca4552e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_24dae183fc8213411602920eca4552e1.jpg already downloaded
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F62%252Fef6216c7f3c199a2385555c43eca16b9%252Fpa%252FLJ03272_ac686484af8ba74e320253f28e634151.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_ac686484af8ba74e320253f28e634151.jpg already downloaded
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F62%252Fef6216c7f3c199a2385555c43eca16b9%252Fpa%252FLJ03272_bbed458abe34640dbc24fc36e6ed4096.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_bbed458abe34640dbc24fc36e6ed4096.jpg already downloaded
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F62%252Fef6216c7f3c199a2385555c43eca16b9%252Fpa%252FLJ03272_772c28ef990be07b0c01ac51b3f8807a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_772c28ef990be07b0c01ac51b3f8807a.jpg already downloaded
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F62%252Fef6216c7f3c199a2385555c43eca16b9%252Fpa%252FLJ03272_bc7e7d90f7d2c4fad24ea6cc94bb856e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_bc7e7d90f7d2c4fad24ea6cc94bb856e.jpg already downloaded
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F62%252Fef6216c7f3c199a2385555c43eca16b9%252Fpa%252FLJ03272_68133873668eb215f0baf31efe9c0c41.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_68133873668eb215f0baf31efe9c0c41.jpg already downloaded
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F62%252Fef6216c7f3c199a2385555c43eca16b9%252Fpa%252FLJ03272_75918eb685e79337de03988e294f945f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_75918eb685e79337de03988e294f945f.jpg already downloaded
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F62%252Fef6216c7f3c199a2385555c43eca16b9%252Fpa%252FLJ03272_a6da5ac02ee97fc93e40deee4b739d39.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_a6da5ac02ee97fc93e40deee4b739d39.jpg already downloaded
2026-03-30 09:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5edea1ad-e110-5136-811c-dec155757da3, identifier: LJ03272
2026-03-30 09:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dc3190>
2026-03-30 09:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_5b5edfa4503f8fdc02256aa5d71c88ce.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_5b5edfa4503f8fdc02256aa5d71c88ce.jpg saved to cache
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fdc75bcf-2509-5b37-a792-79e28573db64
2026-03-30 09:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06365a10>
2026-03-30 09:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_c4c25989b53d5c755d8360cbe9d89aab.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_c4c25989b53d5c755d8360cbe9d89aab.jpg saved to cache
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fdc75bcf-2509-5b37-a792-79e28573db64
2026-03-30 09:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_3b19c169d5aa117118c1cfd5cf3f7458.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_7e01eba25774c5867a46a24147b54264.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_d733648b6b8d6ef8babc9ca51c1c83a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_4c2e77813a1ef0b7347bb33fbc801f1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:24 [auto1.it] INFO: Found listing with ID: VY79198
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY79198%27 HTTP/1.1" 200 None
2026-03-30 09:02:24 [auto1.it] INFO: Scrape type for VY79198: 2
2026-03-30 09:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bbe0ff7-c09f-544d-b780-372c235f98fe with identifier: VY79198
2026-03-30 09:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bbe0ff7-c09f-544d-b780-372c235f98fe with scrape type 2
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bbe0ff7-c09f-544d-b780-372c235f98fe with scrape type 2
2026-03-30 09:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2bbe0ff7-c09f-544d-b780-372c235f98fe, identifier: VY79198
2026-03-30 09:02:24 [auto1.it] INFO: Found listing with ID: MR49146
2026-03-30 09:02:24 [auto1.it] INFO: Found listing with ID: FY24285
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY24285%27 HTTP/1.1" 200 None
2026-03-30 09:02:24 [auto1.it] INFO: Scrape type for FY24285: 2
2026-03-30 09:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bdd172e-e1f5-54ff-a3f8-b30906b09403 with identifier: FY24285
2026-03-30 09:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bdd172e-e1f5-54ff-a3f8-b30906b09403 with scrape type 2
2026-03-30 09:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bdd172e-e1f5-54ff-a3f8-b30906b09403 with scrape type 2
2026-03-30 09:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7bdd172e-e1f5-54ff-a3f8-b30906b09403, identifier: FY24285
2026-03-30 09:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5edea1ad-e110-5136-811c-dec155757da3 with identifier: LJ03272
2026-03-30 09:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5edea1ad-e110-5136-811c-dec155757da3 with identifier: LJ03272
2026-03-30 09:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5edea1ad-e110-5136-811c-dec155757da3 with identifier: LJ03272 to the API
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LJ03272>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:27:44Z',
 'fuel_type': 'diesel',
 'id': '5edea1ad-e110-5136-811c-dec155757da3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ03272',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 101999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_29f66177825ed8ff618fbf9e5aebab2e.jpg',
                'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_3373162eb64e6a7877b8f7a9f625823e.jpg',
                'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_24dae183fc8213411602920eca4552e1.jpg',
                'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_ac686484af8ba74e320253f28e634151.jpg',
                'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_bbed458abe34640dbc24fc36e6ed4096.jpg',
                'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_772c28ef990be07b0c01ac51b3f8807a.jpg',
                'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_bc7e7d90f7d2c4fad24ea6cc94bb856e.jpg',
                'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_68133873668eb215f0baf31efe9c0c41.jpg',
                'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_75918eb685e79337de03988e294f945f.jpg',
                'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_a6da5ac02ee97fc93e40deee4b739d39.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edea1ad-e110-5136-811c-dec155757da3/5edea1ad-e110-5136-811c-dec155757da3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_29f66177825ed8ff618fbf9e5aebab2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edea1ad-e110-5136-811c-dec155757da3/5edea1ad-e110-5136-811c-dec155757da3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2095247,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_3373162eb64e6a7877b8f7a9f625823e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edea1ad-e110-5136-811c-dec155757da3/5edea1ad-e110-5136-811c-dec155757da3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_24dae183fc8213411602920eca4552e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edea1ad-e110-5136-811c-dec155757da3/5edea1ad-e110-5136-811c-dec155757da3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1772486,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_ac686484af8ba74e320253f28e634151.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edea1ad-e110-5136-811c-dec155757da3/5edea1ad-e110-5136-811c-dec155757da3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_bbed458abe34640dbc24fc36e6ed4096.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edea1ad-e110-5136-811c-dec155757da3/5edea1ad-e110-5136-811c-dec155757da3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_772c28ef990be07b0c01ac51b3f8807a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edea1ad-e110-5136-811c-dec155757da3/5edea1ad-e110-5136-811c-dec155757da3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_bc7e7d90f7d2c4fad24ea6cc94bb856e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edea1ad-e110-5136-811c-dec155757da3/5edea1ad-e110-5136-811c-dec155757da3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2078542,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_68133873668eb215f0baf31efe9c0c41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edea1ad-e110-5136-811c-dec155757da3/5edea1ad-e110-5136-811c-dec155757da3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2197957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_75918eb685e79337de03988e294f945f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edea1ad-e110-5136-811c-dec155757da3/5edea1ad-e110-5136-811c-dec155757da3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/62/ef6216c7f3c199a2385555c43eca16b9/pa/LJ03272_a6da5ac02ee97fc93e40deee4b739d39.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.6 JTDM Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2015}
2026-03-30 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ03272%27 HTTP/1.1" 200 None
2026-03-30 09:02:25 [auto1.it] INFO: Saving data for LJ03272: {'created_time': 1774861345.050852, 'last_price_update_time': 1774861345.050867, 'auction_closing_time': 1774970864.0}
2026-03-30 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LJ03272') HTTP/1.1" 204 0
2026-03-30 09:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_cd5616d31cf897cfa3527aec8a7f6a95.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2bbe0ff7-c09f-544d-b780-372c235f98fe with identifier: VY79198
2026-03-30 09:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2bbe0ff7-c09f-544d-b780-372c235f98fe with identifier: VY79198
2026-03-30 09:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2bbe0ff7-c09f-544d-b780-372c235f98fe with identifier: VY79198 to the API
2026-03-30 09:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:02:33Z',
 'fuel_type': 'diesel',
 'id': '2bbe0ff7-c09f-544d-b780-372c235f98fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY79198',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 133138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-21',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Sport Tech 2WD',
 'transmission': 'automatic',
 'trim': 'Sport Tech 2WD',
 'year': 2019}
2026-03-30 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY79198%27 HTTP/1.1" 200 None
2026-03-30 09:02:25 [auto1.it] INFO: Saving data for VY79198: {'auction_closing_time': 1774969353.0, 'created_time': 1773954038.460723, 'last_price_update_time': 1774861345.479686}
2026-03-30 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY79198') HTTP/1.1" 204 0
2026-03-30 09:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7bdd172e-e1f5-54ff-a3f8-b30906b09403 with identifier: FY24285
2026-03-30 09:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7bdd172e-e1f5-54ff-a3f8-b30906b09403 with identifier: FY24285
2026-03-30 09:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7bdd172e-e1f5-54ff-a3f8-b30906b09403 with identifier: FY24285 to the API
2026-03-30 09:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:39:31Z',
 'fuel_type': 'diesel',
 'id': '7bdd172e-e1f5-54ff-a3f8-b30906b09403',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY24285',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 103166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Brave² 4x2',
 'transmission': 'manual',
 'trim': 'Brave² 4x2',
 'year': 2017}
2026-03-30 09:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY24285%27 HTTP/1.1" 200 None
2026-03-30 09:02:26 [auto1.it] INFO: Saving data for FY24285: {'auction_closing_time': 1774971571.0, 'created_time': 1774040747.649832, 'last_price_update_time': 1774861346.015319}
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FY24285') HTTP/1.1" 204 0
2026-03-30 09:02:26 [auto1.it] INFO: Found listing with ID: DS55182
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS55182%27 HTTP/1.1" 200 None
2026-03-30 09:02:26 [auto1.it] INFO: Scrape type for DS55182: 2
2026-03-30 09:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04c0e526-131d-54e5-a71e-dbf30b8b008e with identifier: DS55182
2026-03-30 09:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04c0e526-131d-54e5-a71e-dbf30b8b008e with scrape type 2
2026-03-30 09:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04c0e526-131d-54e5-a71e-dbf30b8b008e with scrape type 2
2026-03-30 09:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 04c0e526-131d-54e5-a71e-dbf30b8b008e, identifier: DS55182
2026-03-30 09:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c87710>
2026-03-30 09:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_e27067b30cec58215e5c2ceb3ad3406b.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_e27067b30cec58215e5c2ceb3ad3406b.jpg saved to cache
2026-03-30 09:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d
2026-03-30 09:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-03-30 09:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-03-30 09:02:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:02:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 09:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-03-30 09:02:26 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:03:27 12:40:04\x00'
2026-03-30 09:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-03-30 09:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e16f10>
2026-03-30 09:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_05deff3d6bba88f307db676da6db3f2a.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_05deff3d6bba88f307db676da6db3f2a.jpg saved to cache
2026-03-30 09:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d
2026-03-30 09:02:26 [auto1.it] INFO: Found listing with ID: AK03087
2026-03-30 09:02:26 [auto1.it] INFO: Found listing with ID: SK14741
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK14741%27 HTTP/1.1" 200 None
2026-03-30 09:02:26 [auto1.it] INFO: Scrape type for SK14741: 2
2026-03-30 09:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ffd2a6-b14e-5f86-9e3f-7350c8fee2b6 with identifier: SK14741
2026-03-30 09:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ffd2a6-b14e-5f86-9e3f-7350c8fee2b6 with scrape type 2
2026-03-30 09:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14ffd2a6-b14e-5f86-9e3f-7350c8fee2b6 with scrape type 2
2026-03-30 09:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 14ffd2a6-b14e-5f86-9e3f-7350c8fee2b6, identifier: SK14741
2026-03-30 09:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 04c0e526-131d-54e5-a71e-dbf30b8b008e with identifier: DS55182
2026-03-30 09:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 04c0e526-131d-54e5-a71e-dbf30b8b008e with identifier: DS55182
2026-03-30 09:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 04c0e526-131d-54e5-a71e-dbf30b8b008e with identifier: DS55182 to the API
2026-03-30 09:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:21:11Z',
 'fuel_type': 'diesel',
 'id': '04c0e526-131d-54e5-a71e-dbf30b8b008e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS55182',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 172118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-31',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 TDCi Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2016}
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS55182%27 HTTP/1.1" 200 None
2026-03-30 09:02:27 [auto1.it] INFO: Saving data for DS55182: {'auction_closing_time': 1774970471.0, 'created_time': 1773935520.015447, 'last_price_update_time': 1774861347.196869}
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DS55182') HTTP/1.1" 204 0
2026-03-30 09:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf2a8961-4303-5d9a-abd5-c028593e4b18 with identifier: LH23516
2026-03-30 09:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf2a8961-4303-5d9a-abd5-c028593e4b18 with scrape type 1
2026-03-30 09:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item bf2a8961-4303-5d9a-abd5-c028593e4b18
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcc%252Fb8cc52aa72a46605af24e4a30e232aae%252Fpa%252FLH23516_b962bc5a87073e35cda0e8a7eec9b6a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_b962bc5a87073e35cda0e8a7eec9b6a0.jpg not downloaded yet
2026-03-30 09:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_5b5afa087977ba4155139fad1fe93b63.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 14ffd2a6-b14e-5f86-9e3f-7350c8fee2b6 with identifier: SK14741
2026-03-30 09:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 14ffd2a6-b14e-5f86-9e3f-7350c8fee2b6 with identifier: SK14741
2026-03-30 09:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 14ffd2a6-b14e-5f86-9e3f-7350c8fee2b6 with identifier: SK14741 to the API
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:21:50Z',
 'fuel_type': 'diesel',
 'id': '14ffd2a6-b14e-5f86-9e3f-7350c8fee2b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK14741',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 183574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-06',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 DI-D Inform 2WD',
 'transmission': 'manual',
 'trim': 'Inform 2WD',
 'year': 2016}
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK14741%27 HTTP/1.1" 200 None
2026-03-30 09:02:27 [auto1.it] INFO: Saving data for SK14741: {'auction_closing_time': 1774970510.0, 'created_time': 1774429230.205551, 'last_price_update_time': 1774861347.584213}
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK14741') HTTP/1.1" 204 0
2026-03-30 09:02:27 [auto1.it] INFO: Found listing with ID: RG52060
2026-03-30 09:02:27 [auto1.it] INFO: Found listing with ID: GX31313
2026-03-30 09:02:27 [auto1.it] INFO: Found listing with ID: CH15776
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH15776%27 HTTP/1.1" 200 None
2026-03-30 09:02:27 [auto1.it] INFO: Scrape type for CH15776: 2
2026-03-30 09:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bb42270-2ce7-54d0-bc29-f8565764417d with identifier: CH15776
2026-03-30 09:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bb42270-2ce7-54d0-bc29-f8565764417d with scrape type 2
2026-03-30 09:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bb42270-2ce7-54d0-bc29-f8565764417d with scrape type 2
2026-03-30 09:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4bb42270-2ce7-54d0-bc29-f8565764417d, identifier: CH15776
2026-03-30 09:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_1451f180ad5cb35f4a6dcd69095542ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:27 [auto1.it] INFO: Found listing with ID: EY99880
2026-03-30 09:02:27 [auto1.it] INFO: Found listing with ID: TW09366
2026-03-30 09:02:27 [auto1.it] INFO: Found listing with ID: DS55182
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS55182%27 HTTP/1.1" 200 None
2026-03-30 09:02:27 [auto1.it] INFO: Scrape type for DS55182: 0
2026-03-30 09:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4bb42270-2ce7-54d0-bc29-f8565764417d with identifier: CH15776
2026-03-30 09:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4bb42270-2ce7-54d0-bc29-f8565764417d with identifier: CH15776
2026-03-30 09:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4bb42270-2ce7-54d0-bc29-f8565764417d with identifier: CH15776 to the API
2026-03-30 09:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:55:17Z',
 'fuel_type': 'petrol',
 'id': '4bb42270-2ce7-54d0-bc29-f8565764417d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH15776',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 161219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-07',
 'seller_name': None,
 'title': 'Volvo V50 1.8 F Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2008}
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH15776%27 HTTP/1.1" 200 None
2026-03-30 09:02:28 [auto1.it] INFO: Saving data for CH15776: {'auction_closing_time': 1774972517.0, 'created_time': 1774559118.7374, 'last_price_update_time': 1774861348.257545}
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CH15776') HTTP/1.1" 204 0
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcc%252Fb8cc52aa72a46605af24e4a30e232aae%252Fpa%252FLH23516_c9b1b0db51c818146af1d41832704ed6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_c9b1b0db51c818146af1d41832704ed6.jpg not downloaded yet
2026-03-30 09:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-03-30 09:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-03-30 09:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 09:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-03-30 09:02:28 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:03:27 12:40:24\x00'
2026-03-30 09:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061cb810>
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_3b19c169d5aa117118c1cfd5cf3f7458.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_3b19c169d5aa117118c1cfd5cf3f7458.jpg saved to cache
2026-03-30 09:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061d2f90>
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_7e01eba25774c5867a46a24147b54264.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_7e01eba25774c5867a46a24147b54264.jpg saved to cache
2026-03-30 09:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fdc75bcf-2509-5b37-a792-79e28573db64
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd1710>
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_d733648b6b8d6ef8babc9ca51c1c83a2.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_d733648b6b8d6ef8babc9ca51c1c83a2.jpg saved to cache
2026-03-30 09:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fdc75bcf-2509-5b37-a792-79e28573db64
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e21b50>
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_4c2e77813a1ef0b7347bb33fbc801f1b.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_4c2e77813a1ef0b7347bb33fbc801f1b.jpg saved to cache
2026-03-30 09:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fdc75bcf-2509-5b37-a792-79e28573db64
2026-03-30 09:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0625da10>
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_cd5616d31cf897cfa3527aec8a7f6a95.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_cd5616d31cf897cfa3527aec8a7f6a95.jpg saved to cache
2026-03-30 09:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205
2026-03-30 09:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_afd7e0653e285a8768a06010baeaba25.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:28 [auto1.it] INFO: Found listing with ID: BN09634
2026-03-30 09:02:28 [auto1.it] INFO: Found listing with ID: MS41612
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS41612%27 HTTP/1.1" 200 None
2026-03-30 09:02:28 [auto1.it] INFO: Scrape type for MS41612: 2
2026-03-30 09:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c73bc9c3-1966-5556-9f5e-94533c1eebc1 with identifier: MS41612
2026-03-30 09:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c73bc9c3-1966-5556-9f5e-94533c1eebc1 with scrape type 2
2026-03-30 09:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c73bc9c3-1966-5556-9f5e-94533c1eebc1 with scrape type 2
2026-03-30 09:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c73bc9c3-1966-5556-9f5e-94533c1eebc1, identifier: MS41612
2026-03-30 09:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c73bc9c3-1966-5556-9f5e-94533c1eebc1 with identifier: MS41612
2026-03-30 09:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c73bc9c3-1966-5556-9f5e-94533c1eebc1 with identifier: MS41612
2026-03-30 09:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c73bc9c3-1966-5556-9f5e-94533c1eebc1 with identifier: MS41612 to the API
2026-03-30 09:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:07:29Z',
 'fuel_type': 'gas',
 'id': 'c73bc9c3-1966-5556-9f5e-94533c1eebc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS41612',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 136509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-30',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 GPL Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2017}
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS41612%27 HTTP/1.1" 200 None
2026-03-30 09:02:29 [auto1.it] INFO: Saving data for MS41612: {'auction_closing_time': 1774969649.0, 'created_time': 1773129553.46149, 'last_price_update_time': 1774861349.376093}
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MS41612') HTTP/1.1" 204 0
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcc%252Fb8cc52aa72a46605af24e4a30e232aae%252Fpa%252FLH23516_6b82f9c84b9e02153dc2c73195cb1990.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_6b82f9c84b9e02153dc2c73195cb1990.jpg not downloaded yet
2026-03-30 09:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_de8e75c09810341076dabd1280132e11.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:29 [auto1.it] INFO: Found listing with ID: HK97988
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK97988%27 HTTP/1.1" 200 None
2026-03-30 09:02:29 [auto1.it] INFO: Scrape type for HK97988: 2
2026-03-30 09:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a5baf6c-7e34-553e-b1ad-2a6f5a62c8fd with identifier: HK97988
2026-03-30 09:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a5baf6c-7e34-553e-b1ad-2a6f5a62c8fd with scrape type 2
2026-03-30 09:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a5baf6c-7e34-553e-b1ad-2a6f5a62c8fd with scrape type 2
2026-03-30 09:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0a5baf6c-7e34-553e-b1ad-2a6f5a62c8fd, identifier: HK97988
2026-03-30 09:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f78cd0>
2026-03-30 09:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_5b5afa087977ba4155139fad1fe93b63.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_5b5afa087977ba4155139fad1fe93b63.jpg saved to cache
2026-03-30 09:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fdc75bcf-2509-5b37-a792-79e28573db64
2026-03-30 09:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061d1390>
2026-03-30 09:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_1451f180ad5cb35f4a6dcd69095542ca.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_1451f180ad5cb35f4a6dcd69095542ca.jpg saved to cache
2026-03-30 09:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205
2026-03-30 09:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0a5baf6c-7e34-553e-b1ad-2a6f5a62c8fd with identifier: HK97988
2026-03-30 09:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0a5baf6c-7e34-553e-b1ad-2a6f5a62c8fd with identifier: HK97988
2026-03-30 09:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0a5baf6c-7e34-553e-b1ad-2a6f5a62c8fd with identifier: HK97988 to the API
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:43:22Z',
 'fuel_type': 'diesel',
 'id': '0a5baf6c-7e34-553e-b1ad-2a6f5a62c8fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK97988',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 226930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-15',
 'seller_name': None,
 'title': 'Jaguar F-Pace 30d Prestige AWD',
 'transmission': 'automatic',
 'trim': 'Prestige AWD',
 'year': 2017}
2026-03-30 09:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK97988%27 HTTP/1.1" 200 None
2026-03-30 09:02:30 [auto1.it] INFO: Saving data for HK97988: {'auction_closing_time': 1774971802.0, 'created_time': 1774015477.652142, 'last_price_update_time': 1774861350.001291}
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HK97988') HTTP/1.1" 204 0
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcc%252Fb8cc52aa72a46605af24e4a30e232aae%252Fpa%252FLH23516_e562ecbf2ad55498f62ad651c6fc0ad0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_e562ecbf2ad55498f62ad651c6fc0ad0.jpg not downloaded yet
2026-03-30 09:02:30 [auto1.it] INFO: Found listing with ID: YE07599
2026-03-30 09:02:30 [auto1.it] INFO: Found listing with ID: VS38043
2026-03-30 09:02:30 [auto1.it] INFO: Found listing with ID: ZF95958
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF95958%27 HTTP/1.1" 200 None
2026-03-30 09:02:30 [auto1.it] INFO: Scrape type for ZF95958: 2
2026-03-30 09:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a490ca4f-3f75-5cc0-8726-1febf7fa9d54 with identifier: ZF95958
2026-03-30 09:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a490ca4f-3f75-5cc0-8726-1febf7fa9d54 with scrape type 2
2026-03-30 09:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a490ca4f-3f75-5cc0-8726-1febf7fa9d54 with scrape type 2
2026-03-30 09:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a490ca4f-3f75-5cc0-8726-1febf7fa9d54, identifier: ZF95958
2026-03-30 09:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a490ca4f-3f75-5cc0-8726-1febf7fa9d54 with identifier: ZF95958
2026-03-30 09:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a490ca4f-3f75-5cc0-8726-1febf7fa9d54 with identifier: ZF95958
2026-03-30 09:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a490ca4f-3f75-5cc0-8726-1febf7fa9d54 with identifier: ZF95958 to the API
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:59:36Z',
 'fuel_type': 'diesel',
 'id': 'a490ca4f-3f75-5cc0-8726-1febf7fa9d54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF95958',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 162122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-29',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2013}
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF95958%27 HTTP/1.1" 200 None
2026-03-30 09:02:30 [auto1.it] INFO: Saving data for ZF95958: {'auction_closing_time': 1774972776.0, 'created_time': 1773478830.625046, 'last_price_update_time': 1774861350.554084}
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZF95958') HTTP/1.1" 204 0
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcc%252Fb8cc52aa72a46605af24e4a30e232aae%252Fpa%252FLH23516_43c551094baa6d1dc9da930d35a0fa6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_43c551094baa6d1dc9da930d35a0fa6b.jpg not downloaded yet
2026-03-30 09:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06125f50>
2026-03-30 09:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_afd7e0653e285a8768a06010baeaba25.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_afd7e0653e285a8768a06010baeaba25.jpg saved to cache
2026-03-30 09:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205
2026-03-30 09:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c9bbd0>
2026-03-30 09:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F50%252F4850902a3cafd680a051e651c01954f2%252Fpa%252FUB63640_de8e75c09810341076dabd1280132e11.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_de8e75c09810341076dabd1280132e11.jpg saved to cache
2026-03-30 09:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdc75bcf-2509-5b37-a792-79e28573db64
2026-03-30 09:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdc75bcf-2509-5b37-a792-79e28573db64, skipping ID generation
2026-03-30 09:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdc75bcf-2509-5b37-a792-79e28573db64 with scrape type 1
2026-03-30 09:02:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdc75bcf-2509-5b37-a792-79e28573db64 sending to next pipeline
2026-03-30 09:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fdc75bcf-2509-5b37-a792-79e28573db64, identifier: UB63640
2026-03-30 09:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_798dda77b6057d348315c1f402a94493.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:30 [auto1.it] INFO: Found listing with ID: GD26025
2026-03-30 09:02:30 [auto1.it] INFO: Found listing with ID: PN24411
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN24411%27 HTTP/1.1" 200 None
2026-03-30 09:02:30 [auto1.it] INFO: Scrape type for PN24411: 1
2026-03-30 09:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fdc75bcf-2509-5b37-a792-79e28573db64 with identifier: UB63640
2026-03-30 09:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fdc75bcf-2509-5b37-a792-79e28573db64 with identifier: UB63640
2026-03-30 09:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fdc75bcf-2509-5b37-a792-79e28573db64 with identifier: UB63640 to the API
2026-03-30 09:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_de8e75c09810341076dabd1280132e11.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:10:22Z',
 'fuel_type': 'diesel',
 'id': 'fdc75bcf-2509-5b37-a792-79e28573db64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB63640',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 56960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_de8e75c09810341076dabd1280132e11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_5b5afa087977ba4155139fad1fe93b63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_7e01eba25774c5867a46a24147b54264.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_d733648b6b8d6ef8babc9ca51c1c83a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_4c2e77813a1ef0b7347bb33fbc801f1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_cad79db1cb48f4e2b82c57227ae5d18c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_c4c25989b53d5c755d8360cbe9d89aab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_13b1fa4e4bb9301b72362e9032229a94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_d57815c0ec8f01b2563392cd94d1b8a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc75bcf-2509-5b37-a792-79e28573db64/fdc75bcf-2509-5b37-a792-79e28573db64_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/50/4850902a3cafd680a051e651c01954f2/pa/UB63640_5b5edfa4503f8fdc02256aa5d71c88ce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d M Sport X',
 'transmission': 'automatic',
 'trim': 'M Sport X',
 'year': 2021}
2026-03-30 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB63640%27 HTTP/1.1" 200 None
2026-03-30 09:02:31 [auto1.it] INFO: Saving data for UB63640: {'created_time': 1774861351.539896, 'last_price_update_time': 1774861351.539908, 'auction_closing_time': 1774969822.0}
2026-03-30 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB63640') HTTP/1.1" 204 0
2026-03-30 09:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_ac9ab0c28779a53846340a78af8c6fac.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcc%252Fb8cc52aa72a46605af24e4a30e232aae%252Fpa%252FLH23516_2a42a1ed48d43c3d5aa5fe3e4513b3ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_2a42a1ed48d43c3d5aa5fe3e4513b3ec.jpg not downloaded yet
2026-03-30 09:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_96107a934f6aa0a6785b2522a63dda6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_e88771ca1650d7d7b17594ea15649487.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:31 [auto1.it] INFO: Found listing with ID: RN34673
2026-03-30 09:02:31 [auto1.it] INFO: Found listing with ID: SJ91765
2026-03-30 09:02:31 [auto1.it] INFO: Found listing with ID: ZP51405
2026-03-30 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP51405%27 HTTP/1.1" 200 None
2026-03-30 09:02:31 [auto1.it] INFO: Scrape type for ZP51405: 2
2026-03-30 09:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0466bfad-6f25-51a6-af10-c9bde21442ce with identifier: ZP51405
2026-03-30 09:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0466bfad-6f25-51a6-af10-c9bde21442ce with scrape type 2
2026-03-30 09:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0466bfad-6f25-51a6-af10-c9bde21442ce with scrape type 2
2026-03-30 09:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0466bfad-6f25-51a6-af10-c9bde21442ce, identifier: ZP51405
2026-03-30 09:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_89c6065d9cf2d1ca6c11caa769f4c0e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0466bfad-6f25-51a6-af10-c9bde21442ce with identifier: ZP51405
2026-03-30 09:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0466bfad-6f25-51a6-af10-c9bde21442ce with identifier: ZP51405
2026-03-30 09:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0466bfad-6f25-51a6-af10-c9bde21442ce with identifier: ZP51405 to the API
2026-03-30 09:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:28:10Z',
 'fuel_type': 'diesel',
 'id': '0466bfad-6f25-51a6-af10-c9bde21442ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP51405',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 181852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-18',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2016}
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP51405%27 HTTP/1.1" 200 None
2026-03-30 09:02:32 [auto1.it] INFO: Saving data for ZP51405: {'auction_closing_time': 1774970890.0, 'created_time': 1774472528.826916, 'last_price_update_time': 1774861352.084074}
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZP51405') HTTP/1.1" 204 0
2026-03-30 09:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT52131> (referer: https://www.auto1.com/v1/car-details-view/HT52131/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_5dc3e59bfa2a43dfb88fe13fcd32eb6e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:32 [auto1.it] INFO: Found listing with ID: PE97517
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE97517%27 HTTP/1.1" 200 None
2026-03-30 09:02:32 [auto1.it] INFO: Scrape type for PE97517: 2
2026-03-30 09:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de5b3c21-8b7e-51ce-8a7c-d5339281d172 with identifier: PE97517
2026-03-30 09:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de5b3c21-8b7e-51ce-8a7c-d5339281d172 with scrape type 2
2026-03-30 09:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de5b3c21-8b7e-51ce-8a7c-d5339281d172 with scrape type 2
2026-03-30 09:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: de5b3c21-8b7e-51ce-8a7c-d5339281d172, identifier: PE97517
2026-03-30 09:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cbc250>
2026-03-30 09:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_798dda77b6057d348315c1f402a94493.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_798dda77b6057d348315c1f402a94493.jpg saved to cache
2026-03-30 09:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205
2026-03-30 09:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_43c551094baa6d1dc9da930d35a0fa6b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_b962bc5a87073e35cda0e8a7eec9b6a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: de5b3c21-8b7e-51ce-8a7c-d5339281d172 with identifier: PE97517
2026-03-30 09:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: de5b3c21-8b7e-51ce-8a7c-d5339281d172 with identifier: PE97517
2026-03-30 09:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: de5b3c21-8b7e-51ce-8a7c-d5339281d172 with identifier: PE97517 to the API
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:22:55Z',
 'fuel_type': 'petrol',
 'id': 'de5b3c21-8b7e-51ce-8a7c-d5339281d172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE97517',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 164803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-29',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Star View 4x2',
 'transmission': 'automatic',
 'trim': 'Star View 4x2',
 'year': 2019}
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE97517%27 HTTP/1.1" 200 None
2026-03-30 09:02:32 [auto1.it] INFO: Saving data for PE97517: {'auction_closing_time': 1774970575.0, 'created_time': 1773327938.255739, 'last_price_update_time': 1774861352.801085}
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PE97517') HTTP/1.1" 204 0
2026-03-30 09:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_c9b1b0db51c818146af1d41832704ed6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:32 [auto1.it] INFO: Found listing with ID: UK55299
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK55299%27 HTTP/1.1" 200 None
2026-03-30 09:02:32 [auto1.it] INFO: Scrape type for UK55299: 2
2026-03-30 09:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90cb13b1-388c-5017-8d8f-b53b113aab42 with identifier: UK55299
2026-03-30 09:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90cb13b1-388c-5017-8d8f-b53b113aab42 with scrape type 2
2026-03-30 09:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90cb13b1-388c-5017-8d8f-b53b113aab42 with scrape type 2
2026-03-30 09:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 90cb13b1-388c-5017-8d8f-b53b113aab42, identifier: UK55299
2026-03-30 09:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0626b790>
2026-03-30 09:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_ac9ab0c28779a53846340a78af8c6fac.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_ac9ab0c28779a53846340a78af8c6fac.jpg saved to cache
2026-03-30 09:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:03:27 12:35:31\x00'
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cb6810>
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_96107a934f6aa0a6785b2522a63dda6d.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_96107a934f6aa0a6785b2522a63dda6d.jpg saved to cache
2026-03-30 09:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 905b485c-0fa3-5fcf-9211-e634367836fb
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0622df90>
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_e88771ca1650d7d7b17594ea15649487.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_e88771ca1650d7d7b17594ea15649487.jpg saved to cache
2026-03-30 09:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 905b485c-0fa3-5fcf-9211-e634367836fb
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d06c890>
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_89c6065d9cf2d1ca6c11caa769f4c0e2.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_89c6065d9cf2d1ca6c11caa769f4c0e2.jpg saved to cache
2026-03-30 09:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 905b485c-0fa3-5fcf-9211-e634367836fb
2026-03-30 09:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 90cb13b1-388c-5017-8d8f-b53b113aab42 with identifier: UK55299
2026-03-30 09:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 90cb13b1-388c-5017-8d8f-b53b113aab42 with identifier: UK55299
2026-03-30 09:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 90cb13b1-388c-5017-8d8f-b53b113aab42 with identifier: UK55299 to the API
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:00:26Z',
 'fuel_type': 'diesel',
 'id': '90cb13b1-388c-5017-8d8f-b53b113aab42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK55299',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Paceman',
 'odometer': 243001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-26',
 'seller_name': None,
 'title': 'MINI Paceman Cooper SD ALL4',
 'transmission': 'manual',
 'trim': 'ALL4',
 'year': 2013}
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK55299%27 HTTP/1.1" 200 None
2026-03-30 09:02:33 [auto1.it] INFO: Saving data for UK55299: {'auction_closing_time': 1774969226.0, 'created_time': 1773349224.642061, 'last_price_update_time': 1774861353.728314}
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UK55299') HTTP/1.1" 204 0
2026-03-30 09:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0066079f-1ba1-5322-810b-b31ff6e67689 with identifier: HT52131
2026-03-30 09:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0066079f-1ba1-5322-810b-b31ff6e67689 with scrape type 1
2026-03-30 09:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0066079f-1ba1-5322-810b-b31ff6e67689
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_6ff56f8c31b98153e4108cc8c0ad544f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_6ff56f8c31b98153e4108cc8c0ad544f.jpg not downloaded yet
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:03:27 12:35:21\x00'
2026-03-30 09:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f79fd0>
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_5dc3e59bfa2a43dfb88fe13fcd32eb6e.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_5dc3e59bfa2a43dfb88fe13fcd32eb6e.jpg saved to cache
2026-03-30 09:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 905b485c-0fa3-5fcf-9211-e634367836fb
2026-03-30 09:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_e562ecbf2ad55498f62ad651c6fc0ad0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_6b82f9c84b9e02153dc2c73195cb1990.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:33 [auto1.it] INFO: Found listing with ID: UE49682
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE49682%27 HTTP/1.1" 200 None
2026-03-30 09:02:33 [auto1.it] INFO: Scrape type for UE49682: 2
2026-03-30 09:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 034653e5-3557-539a-8c6a-37d36d6802bd with identifier: UE49682
2026-03-30 09:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 034653e5-3557-539a-8c6a-37d36d6802bd with scrape type 2
2026-03-30 09:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 034653e5-3557-539a-8c6a-37d36d6802bd with scrape type 2
2026-03-30 09:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 034653e5-3557-539a-8c6a-37d36d6802bd, identifier: UE49682
2026-03-30 09:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VU13250> (referer: https://www.auto1.com/v1/car-details-view/VU13250/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_2a42a1ed48d43c3d5aa5fe3e4513b3ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_a0bff0f07754123cc29507454fb4f24d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 034653e5-3557-539a-8c6a-37d36d6802bd with identifier: UE49682
2026-03-30 09:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 034653e5-3557-539a-8c6a-37d36d6802bd with identifier: UE49682
2026-03-30 09:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 034653e5-3557-539a-8c6a-37d36d6802bd with identifier: UE49682 to the API
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:52:56Z',
 'fuel_type': 'diesel',
 'id': '034653e5-3557-539a-8c6a-37d36d6802bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE49682',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 244491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi ST-Line Business',
 'transmission': 'automatic',
 'trim': 'ST-Line Business',
 'year': 2019}
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE49682%27 HTTP/1.1" 200 None
2026-03-30 09:02:34 [auto1.it] INFO: Saving data for UE49682: {'auction_closing_time': 1774972376.0, 'created_time': 1774447237.708696, 'last_price_update_time': 1774861354.76156}
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UE49682') HTTP/1.1" 204 0
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_bdfdaf831a3bf168515737b87e76fb6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_bdfdaf831a3bf168515737b87e76fb6a.jpg not downloaded yet
2026-03-30 09:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM54486> (referer: https://www.auto1.com/v1/car-details-view/ZM54486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV41912> (referer: https://www.auto1.com/v1/car-details-view/SV41912/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd7dd0>
2026-03-30 09:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf2a8961-4303-5d9a-abd5-c028593e4b18/bf2a8961-4303-5d9a-abd5-c028593e4b18_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcc%252Fb8cc52aa72a46605af24e4a30e232aae%252Fpa%252FLH23516_43c551094baa6d1dc9da930d35a0fa6b.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_43c551094baa6d1dc9da930d35a0fa6b.jpg saved to cache
2026-03-30 09:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf2a8961-4303-5d9a-abd5-c028593e4b18
2026-03-30 09:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06eba610>
2026-03-30 09:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf2a8961-4303-5d9a-abd5-c028593e4b18/bf2a8961-4303-5d9a-abd5-c028593e4b18_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcc%252Fb8cc52aa72a46605af24e4a30e232aae%252Fpa%252FLH23516_b962bc5a87073e35cda0e8a7eec9b6a0.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_b962bc5a87073e35cda0e8a7eec9b6a0.jpg saved to cache
2026-03-30 09:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf2a8961-4303-5d9a-abd5-c028593e4b18
2026-03-30 09:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c129d0>
2026-03-30 09:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf2a8961-4303-5d9a-abd5-c028593e4b18/bf2a8961-4303-5d9a-abd5-c028593e4b18_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcc%252Fb8cc52aa72a46605af24e4a30e232aae%252Fpa%252FLH23516_c9b1b0db51c818146af1d41832704ed6.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_c9b1b0db51c818146af1d41832704ed6.jpg saved to cache
2026-03-30 09:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf2a8961-4303-5d9a-abd5-c028593e4b18
2026-03-30 09:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_a95047ba88d4cf66c7c67ff879314eb1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:34 [auto1.it] INFO: Found listing with ID: HY22181
2026-03-30 09:02:34 [auto1.it] INFO: Found listing with ID: SX71536
2026-03-30 09:02:34 [auto1.it] INFO: Found listing with ID: MT61619
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT61619%27 HTTP/1.1" 200 None
2026-03-30 09:02:34 [auto1.it] INFO: Scrape type for MT61619: 2
2026-03-30 09:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2abfedd7-6605-5a54-bdd0-20ea76fc787b with identifier: MT61619
2026-03-30 09:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2abfedd7-6605-5a54-bdd0-20ea76fc787b with scrape type 2
2026-03-30 09:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2abfedd7-6605-5a54-bdd0-20ea76fc787b with scrape type 2
2026-03-30 09:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2abfedd7-6605-5a54-bdd0-20ea76fc787b, identifier: MT61619
2026-03-30 09:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2abfedd7-6605-5a54-bdd0-20ea76fc787b with identifier: MT61619
2026-03-30 09:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2abfedd7-6605-5a54-bdd0-20ea76fc787b with identifier: MT61619
2026-03-30 09:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2abfedd7-6605-5a54-bdd0-20ea76fc787b with identifier: MT61619 to the API
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:32:48Z',
 'fuel_type': 'diesel',
 'id': '2abfedd7-6605-5a54-bdd0-20ea76fc787b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT61619',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 159372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Advance BlueMotion',
 'transmission': 'manual',
 'trim': 'Advance BlueMotion',
 'year': 2011}
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT61619%27 HTTP/1.1" 200 None
2026-03-30 09:02:35 [auto1.it] INFO: Saving data for MT61619: {'auction_closing_time': 1774971168.0, 'created_time': 1773138497.829802, 'last_price_update_time': 1774861355.556846}
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MT61619') HTTP/1.1" 204 0
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_040ef793972fdffb0bb74db6f339f924.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_040ef793972fdffb0bb74db6f339f924.jpg not downloaded yet
2026-03-30 09:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ec5590>
2026-03-30 09:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf2a8961-4303-5d9a-abd5-c028593e4b18/bf2a8961-4303-5d9a-abd5-c028593e4b18_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcc%252Fb8cc52aa72a46605af24e4a30e232aae%252Fpa%252FLH23516_e562ecbf2ad55498f62ad651c6fc0ad0.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_e562ecbf2ad55498f62ad651c6fc0ad0.jpg saved to cache
2026-03-30 09:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf2a8961-4303-5d9a-abd5-c028593e4b18
2026-03-30 09:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062bfe90>
2026-03-30 09:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf2a8961-4303-5d9a-abd5-c028593e4b18/bf2a8961-4303-5d9a-abd5-c028593e4b18_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcc%252Fb8cc52aa72a46605af24e4a30e232aae%252Fpa%252FLH23516_6b82f9c84b9e02153dc2c73195cb1990.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_6b82f9c84b9e02153dc2c73195cb1990.jpg saved to cache
2026-03-30 09:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf2a8961-4303-5d9a-abd5-c028593e4b18
2026-03-30 09:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b767cebb-7d47-58e7-bed7-591a8c61d7d3 with identifier: VU13250
2026-03-30 09:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b767cebb-7d47-58e7-bed7-591a8c61d7d3 with scrape type 1
2026-03-30 09:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b767cebb-7d47-58e7-bed7-591a8c61d7d3
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_e8b5584a90a002aa86191091a9b7d949.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_e8b5584a90a002aa86191091a9b7d949.jpg not downloaded yet
2026-03-30 09:02:35 [auto1.it] INFO: Found listing with ID: ZF01479
2026-03-30 09:02:35 [auto1.it] INFO: Found listing with ID: ZD65327
2026-03-30 09:02:35 [auto1.it] INFO: Found listing with ID: KF98112
2026-03-30 09:02:35 [auto1.it] INFO: Found listing with ID: UY95940
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY95940%27 HTTP/1.1" 200 None
2026-03-30 09:02:35 [auto1.it] INFO: Scrape type for UY95940: 2
2026-03-30 09:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d36dba0-9b17-5039-b10b-10f372149fa1 with identifier: UY95940
2026-03-30 09:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d36dba0-9b17-5039-b10b-10f372149fa1 with scrape type 2
2026-03-30 09:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d36dba0-9b17-5039-b10b-10f372149fa1 with scrape type 2
2026-03-30 09:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d36dba0-9b17-5039-b10b-10f372149fa1, identifier: UY95940
2026-03-30 09:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06126850>
2026-03-30 09:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf2a8961-4303-5d9a-abd5-c028593e4b18/bf2a8961-4303-5d9a-abd5-c028593e4b18_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fcc%252Fb8cc52aa72a46605af24e4a30e232aae%252Fpa%252FLH23516_2a42a1ed48d43c3d5aa5fe3e4513b3ec.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_2a42a1ed48d43c3d5aa5fe3e4513b3ec.jpg saved to cache
2026-03-30 09:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf2a8961-4303-5d9a-abd5-c028593e4b18
2026-03-30 09:02:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf2a8961-4303-5d9a-abd5-c028593e4b18, skipping ID generation
2026-03-30 09:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf2a8961-4303-5d9a-abd5-c028593e4b18 with scrape type 1
2026-03-30 09:02:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf2a8961-4303-5d9a-abd5-c028593e4b18 sending to next pipeline
2026-03-30 09:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf2a8961-4303-5d9a-abd5-c028593e4b18, identifier: LH23516
2026-03-30 09:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0627e610>
2026-03-30 09:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_a0bff0f07754123cc29507454fb4f24d.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_a0bff0f07754123cc29507454fb4f24d.jpg saved to cache
2026-03-30 09:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205
2026-03-30 09:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea036585-d06d-57db-92c9-a238b1e2a9ac with identifier: ZM54486
2026-03-30 09:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea036585-d06d-57db-92c9-a238b1e2a9ac with scrape type 1
2026-03-30 09:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea036585-d06d-57db-92c9-a238b1e2a9ac
2026-03-30 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_a6f4898fa3113d0159091700fa221834.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_a6f4898fa3113d0159091700fa221834.jpg not downloaded yet
2026-03-30 09:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6b5115d-0763-5fa7-9224-5ab626f7aed2 with identifier: SV41912
2026-03-30 09:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6b5115d-0763-5fa7-9224-5ab626f7aed2 with scrape type 1
2026-03-30 09:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c6b5115d-0763-5fa7-9224-5ab626f7aed2
2026-03-30 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc4%252F5bc49a628e55b53fa9fa9543d4c00524%252Fpa%252FSV41912_8f2401bbdcb07777d5aff90bc8d3ec39.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_8f2401bbdcb07777d5aff90bc8d3ec39.jpg not downloaded yet
2026-03-30 09:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_cfe6690abd508fc59e139f03029ff22f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_4a0a789ab5e2fd2ff5459dc3d4d63bde.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_82edf39051b52198e5db5a9c089f9ed0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d36dba0-9b17-5039-b10b-10f372149fa1 with identifier: UY95940
2026-03-30 09:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:02:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 09:02:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d36dba0-9b17-5039-b10b-10f372149fa1 with identifier: UY95940
2026-03-30 09:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d36dba0-9b17-5039-b10b-10f372149fa1 with identifier: UY95940 to the API
2026-03-30 09:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:01:28Z',
 'fuel_type': 'petrol',
 'id': '4d36dba0-9b17-5039-b10b-10f372149fa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY95940',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 106264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2014}
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY95940%27 HTTP/1.1" 200 None
2026-03-30 09:02:37 [auto1.it] INFO: Saving data for UY95940: {'auction_closing_time': 1774969288.0, 'created_time': 1774353652.43648, 'last_price_update_time': 1774861357.251816}
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UY95940') HTTP/1.1" 204 0
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_80b9fbde16d092e6143b047cee5e9871.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_80b9fbde16d092e6143b047cee5e9871.jpg not downloaded yet
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_f23409d5b70a59199bd9baf760cae375.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_f23409d5b70a59199bd9baf760cae375.jpg not downloaded yet
2026-03-30 09:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf2a8961-4303-5d9a-abd5-c028593e4b18 with identifier: LH23516
2026-03-30 09:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf2a8961-4303-5d9a-abd5-c028593e4b18 with identifier: LH23516
2026-03-30 09:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf2a8961-4303-5d9a-abd5-c028593e4b18 with identifier: LH23516 to the API
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_2a42a1ed48d43c3d5aa5fe3e4513b3ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:29:35Z',
 'fuel_type': 'diesel',
 'id': 'bf2a8961-4303-5d9a-abd5-c028593e4b18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH23516',
 'listing': 'auction',
 'location': 'IT, Modugno',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 368756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf2a8961-4303-5d9a-abd5-c028593e4b18/bf2a8961-4303-5d9a-abd5-c028593e4b18_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_b962bc5a87073e35cda0e8a7eec9b6a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf2a8961-4303-5d9a-abd5-c028593e4b18/bf2a8961-4303-5d9a-abd5-c028593e4b18_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_c9b1b0db51c818146af1d41832704ed6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf2a8961-4303-5d9a-abd5-c028593e4b18/bf2a8961-4303-5d9a-abd5-c028593e4b18_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_6b82f9c84b9e02153dc2c73195cb1990.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf2a8961-4303-5d9a-abd5-c028593e4b18/bf2a8961-4303-5d9a-abd5-c028593e4b18_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_e562ecbf2ad55498f62ad651c6fc0ad0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf2a8961-4303-5d9a-abd5-c028593e4b18/bf2a8961-4303-5d9a-abd5-c028593e4b18_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_43c551094baa6d1dc9da930d35a0fa6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf2a8961-4303-5d9a-abd5-c028593e4b18/bf2a8961-4303-5d9a-abd5-c028593e4b18_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/cc/b8cc52aa72a46605af24e4a30e232aae/pa/LH23516_2a42a1ed48d43c3d5aa5fe3e4513b3ec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2011}
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH23516%27 HTTP/1.1" 200 None
2026-03-30 09:02:37 [auto1.it] INFO: Saving data for LH23516: {'created_time': 1774861357.790701, 'last_price_update_time': 1774861357.790717, 'auction_closing_time': 1774970975.0}
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LH23516') HTTP/1.1" 204 0
2026-03-30 09:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_2f616bd20fca91cd373d7cd46876daa9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_2c1ded33e73233368e5eadeeacbbb527.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:37 [auto1.it] INFO: Found listing with ID: SP08932
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP08932%27 HTTP/1.1" 200 None
2026-03-30 09:02:37 [auto1.it] INFO: Scrape type for SP08932: 2
2026-03-30 09:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a759f7fc-7dce-5bd2-b16e-26eeb953449f with identifier: SP08932
2026-03-30 09:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a759f7fc-7dce-5bd2-b16e-26eeb953449f with scrape type 2
2026-03-30 09:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a759f7fc-7dce-5bd2-b16e-26eeb953449f with scrape type 2
2026-03-30 09:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a759f7fc-7dce-5bd2-b16e-26eeb953449f, identifier: SP08932
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_d88c43e122e4b0a71668edae99a52b40.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_d88c43e122e4b0a71668edae99a52b40.jpg not downloaded yet
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc4%252F5bc49a628e55b53fa9fa9543d4c00524%252Fpa%252FSV41912_a060104cc002b3148a63150f89af3ce8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_a060104cc002b3148a63150f89af3ce8.jpg not downloaded yet
2026-03-30 09:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN24411/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cc08d0>
2026-03-30 09:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_a95047ba88d4cf66c7c67ff879314eb1.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_a95047ba88d4cf66c7c67ff879314eb1.jpg saved to cache
2026-03-30 09:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205
2026-03-30 09:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_1869916f1bcba20dfd8f4fd235561e3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a759f7fc-7dce-5bd2-b16e-26eeb953449f with identifier: SP08932
2026-03-30 09:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a759f7fc-7dce-5bd2-b16e-26eeb953449f with identifier: SP08932
2026-03-30 09:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a759f7fc-7dce-5bd2-b16e-26eeb953449f with identifier: SP08932 to the API
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-31T15:31:15Z',
 'fuel_type': 'diesel',
 'id': 'a759f7fc-7dce-5bd2-b16e-26eeb953449f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP08932',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 192553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2020}
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP08932%27 HTTP/1.1" 200 None
2026-03-30 09:02:38 [auto1.it] INFO: Saving data for SP08932: {'auction_closing_time': 1774971075.0, 'created_time': 1773954089.516153, 'last_price_update_time': 1774861358.45138}
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SP08932') HTTP/1.1" 204 0
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_b35865d427b83b4cfa8019111a962f31.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_b35865d427b83b4cfa8019111a962f31.jpg not downloaded yet
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_a190697f2f90e999fc9742c14e368a31.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_a190697f2f90e999fc9742c14e368a31.jpg not downloaded yet
2026-03-30 09:02:38 [auto1.it] INFO: Found listing with ID: RZ71540
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ71540%27 HTTP/1.1" 200 None
2026-03-30 09:02:38 [auto1.it] INFO: Scrape type for RZ71540: 2
2026-03-30 09:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4b8f467-0f7d-575c-90af-18c1c63998bb with identifier: RZ71540
2026-03-30 09:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4b8f467-0f7d-575c-90af-18c1c63998bb with scrape type 2
2026-03-30 09:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4b8f467-0f7d-575c-90af-18c1c63998bb with scrape type 2
2026-03-30 09:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4b8f467-0f7d-575c-90af-18c1c63998bb, identifier: RZ71540
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_9941a50215932b4ff30c344692f0a417.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_9941a50215932b4ff30c344692f0a417.jpg not downloaded yet
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc4%252F5bc49a628e55b53fa9fa9543d4c00524%252Fpa%252FSV41912_3008aa2b4b943c52ff0b5194110ba55a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_3008aa2b4b943c52ff0b5194110ba55a.jpg not downloaded yet
2026-03-30 09:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK43597/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4b8f467-0f7d-575c-90af-18c1c63998bb with identifier: RZ71540
2026-03-30 09:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4b8f467-0f7d-575c-90af-18c1c63998bb with identifier: RZ71540
2026-03-30 09:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4b8f467-0f7d-575c-90af-18c1c63998bb with identifier: RZ71540 to the API
2026-03-30 09:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:59:57Z',
 'fuel_type': 'diesel',
 'id': 'b4b8f467-0f7d-575c-90af-18c1c63998bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ71540',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 195368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-08',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Business BlueMotion',
 'transmission': 'automatic',
 'trim': 'Business BlueMotion',
 'year': 2019}
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ71540%27 HTTP/1.1" 200 None
2026-03-30 09:02:39 [auto1.it] INFO: Saving data for RZ71540: {'auction_closing_time': 1774972797.0, 'created_time': 1773267306.814385, 'last_price_update_time': 1774861359.227001}
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RZ71540') HTTP/1.1" 204 0
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_06157016f748e0558fc07691fd2cc602.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_06157016f748e0558fc07691fd2cc602.jpg not downloaded yet
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_fbc3dd555a610142dc5f2a548b042f2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_fbc3dd555a610142dc5f2a548b042f2d.jpg not downloaded yet
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063aa650>
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_cfe6690abd508fc59e139f03029ff22f.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_cfe6690abd508fc59e139f03029ff22f.jpg saved to cache
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 905b485c-0fa3-5fcf-9211-e634367836fb
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06233390>
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fdc%252F3fdcd02fc17ed6f74b99acbc7598deec%252Fpa%252FCK19595_4a0a789ab5e2fd2ff5459dc3d4d63bde.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_4a0a789ab5e2fd2ff5459dc3d4d63bde.jpg saved to cache
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d
2026-03-30 09:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1f7cbab-ab66-5b48-9635-a2dabcb7922d, skipping ID generation
2026-03-30 09:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d with scrape type 1
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1f7cbab-ab66-5b48-9635-a2dabcb7922d sending to next pipeline
2026-03-30 09:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c1f7cbab-ab66-5b48-9635-a2dabcb7922d, identifier: CK19595
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e7f410>
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fc6%252F81c6f7534b39b1b989e8b1605ceb3fd5%252Fpa%252FYX59353_82edf39051b52198e5db5a9c089f9ed0.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_82edf39051b52198e5db5a9c089f9ed0.jpg saved to cache
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205
2026-03-30 09:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cde1fe2-2e56-5f10-bb1f-e13e714ec205, skipping ID generation
2026-03-30 09:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205 with scrape type 1
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8cde1fe2-2e56-5f10-bb1f-e13e714ec205 sending to next pipeline
2026-03-30 09:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8cde1fe2-2e56-5f10-bb1f-e13e714ec205, identifier: YX59353
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06243550>
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_2f616bd20fca91cd373d7cd46876daa9.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_2f616bd20fca91cd373d7cd46876daa9.jpg saved to cache
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4509fd91-d60a-517e-a196-7566eeb8ca80
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dce3d0>
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59cfabbb-5ae0-5a2d-a230-cac57f32ebb9/59cfabbb-5ae0-5a2d-a230-cac57f32ebb9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F32%252F793261912116f19bcabfea47eed89349%252Fpa%252FTX80167_2c1ded33e73233368e5eadeeacbbb527.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_2c1ded33e73233368e5eadeeacbbb527.jpg saved to cache
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9
2026-03-30 09:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9, skipping ID generation
2026-03-30 09:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9 with scrape type 1
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9 sending to next pipeline
2026-03-30 09:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9, identifier: TX80167
2026-03-30 09:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_40aa1072fc2af8849685b457c7e7d2e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:39 [auto1.it] INFO: Found listing with ID: LX93487
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX93487%27 HTTP/1.1" 200 None
2026-03-30 09:02:39 [auto1.it] INFO: Scrape type for LX93487: 2
2026-03-30 09:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7188376f-2d45-58b9-a4e2-fd7687b09d0b with identifier: LX93487
2026-03-30 09:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7188376f-2d45-58b9-a4e2-fd7687b09d0b with scrape type 2
2026-03-30 09:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7188376f-2d45-58b9-a4e2-fd7687b09d0b with scrape type 2
2026-03-30 09:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7188376f-2d45-58b9-a4e2-fd7687b09d0b, identifier: LX93487
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_aa03cf1faf915b54c255e447b984d71f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_aa03cf1faf915b54c255e447b984d71f.jpg not downloaded yet
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc4%252F5bc49a628e55b53fa9fa9543d4c00524%252Fpa%252FSV41912_d8ebf823ba405d262927b54c1aa0ac43.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_d8ebf823ba405d262927b54c1aa0ac43.jpg not downloaded yet
2026-03-30 09:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c1f7cbab-ab66-5b48-9635-a2dabcb7922d with identifier: CK19595
2026-03-30 09:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c1f7cbab-ab66-5b48-9635-a2dabcb7922d with identifier: CK19595
2026-03-30 09:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c1f7cbab-ab66-5b48-9635-a2dabcb7922d with identifier: CK19595 to the API
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_4a0a789ab5e2fd2ff5459dc3d4d63bde.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:23:09Z',
 'fuel_type': 'diesel',
 'id': 'c1f7cbab-ab66-5b48-9635-a2dabcb7922d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK19595',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 153930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1010019,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_e6b0f93a990b7562c0c4f768d4d29543.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1010019,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_2d2190a1a9071d379ad1110b0ca03636.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716892,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_f404d9c64ff718b6e61e388ce4d364c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437069,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_f1fa1b174f55150a67f5821e78009314.jpg',
             'Width': 1547},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 893802,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_e27067b30cec58215e5c2ceb3ad3406b.jpg',
             'Width': 1952},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1110633,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_4a0a789ab5e2fd2ff5459dc3d4d63bde.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_ac9ab0c28779a53846340a78af8c6fac.jpg',
             'Width': 1652},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813192,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_05deff3d6bba88f307db676da6db3f2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426254,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_d0dcffb6990941680fed2cf21c224004.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f7cbab-ab66-5b48-9635-a2dabcb7922d/c1f7cbab-ab66-5b48-9635-a2dabcb7922d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661268,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/dc/3fdcd02fc17ed6f74b99acbc7598deec/pa/CK19595_3b19c169d5aa117118c1cfd5cf3f7458.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L1',
 'transmission': 'manual',
 'trim': '310 L1',
 'year': 2017}
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK19595%27 HTTP/1.1" 200 None
2026-03-30 09:02:40 [auto1.it] INFO: Saving data for CK19595: {'created_time': 1774861360.512456, 'last_price_update_time': 1774861360.512467, 'auction_closing_time': 1774970589.0}
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CK19595') HTTP/1.1" 204 0
2026-03-30 09:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8cde1fe2-2e56-5f10-bb1f-e13e714ec205 with identifier: YX59353
2026-03-30 09:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8cde1fe2-2e56-5f10-bb1f-e13e714ec205 with identifier: YX59353
2026-03-30 09:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8cde1fe2-2e56-5f10-bb1f-e13e714ec205 with identifier: YX59353 to the API
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_82edf39051b52198e5db5a9c089f9ed0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:44:40Z',
 'fuel_type': 'diesel',
 'id': '8cde1fe2-2e56-5f10-bb1f-e13e714ec205',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX59353',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 176790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_82edf39051b52198e5db5a9c089f9ed0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_813a9c975de9d9761dad48b24703dff1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_a95047ba88d4cf66c7c67ff879314eb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_fd2a2e99ec2df0bbb72f1d78dca5b40f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_a0bff0f07754123cc29507454fb4f24d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_798dda77b6057d348315c1f402a94493.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_afd7e0653e285a8768a06010baeaba25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_1451f180ad5cb35f4a6dcd69095542ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_cd5616d31cf897cfa3527aec8a7f6a95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cde1fe2-2e56-5f10-bb1f-e13e714ec205/8cde1fe2-2e56-5f10-bb1f-e13e714ec205_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/c6/81c6f7534b39b1b989e8b1605ceb3fd5/pa/YX59353_fe51923a44fde04cf3d61b9d3180a88b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi Comfort 4WD',
 'transmission': 'automatic',
 'trim': 'Comfort 4WD',
 'year': 2015}
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX59353%27 HTTP/1.1" 200 None
2026-03-30 09:02:40 [auto1.it] INFO: Saving data for YX59353: {'created_time': 1774861360.956865, 'last_price_update_time': 1774861360.956876, 'auction_closing_time': 1774971880.0}
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YX59353') HTTP/1.1" 204 0
2026-03-30 09:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9 with identifier: TX80167
2026-03-30 09:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9 with identifier: TX80167
2026-03-30 09:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 59cfabbb-5ae0-5a2d-a230-cac57f32ebb9 with identifier: TX80167 to the API
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_2c1ded33e73233368e5eadeeacbbb527.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:27:03Z',
 'fuel_type': 'petrol',
 'id': '59cfabbb-5ae0-5a2d-a230-cac57f32ebb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX80167',
 'listing': 'auction',
 'location': 'IT, Verona',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 36528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59cfabbb-5ae0-5a2d-a230-cac57f32ebb9/59cfabbb-5ae0-5a2d-a230-cac57f32ebb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_2c1ded33e73233368e5eadeeacbbb527.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59cfabbb-5ae0-5a2d-a230-cac57f32ebb9/59cfabbb-5ae0-5a2d-a230-cac57f32ebb9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_38e6c22bae04048d5f70e729a6fee164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59cfabbb-5ae0-5a2d-a230-cac57f32ebb9/59cfabbb-5ae0-5a2d-a230-cac57f32ebb9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_c8d899e8595a56be55e9e23d7203eaa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59cfabbb-5ae0-5a2d-a230-cac57f32ebb9/59cfabbb-5ae0-5a2d-a230-cac57f32ebb9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_b54cc62994a76e31a83179e29d3c65a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59cfabbb-5ae0-5a2d-a230-cac57f32ebb9/59cfabbb-5ae0-5a2d-a230-cac57f32ebb9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/32/793261912116f19bcabfea47eed89349/pa/TX80167_0559b7ce8175dd0ac917ff22dd723aa2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2003}
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX80167%27 HTTP/1.1" 200 None
2026-03-30 09:02:41 [auto1.it] INFO: Saving data for TX80167: {'created_time': 1774861361.388796, 'last_price_update_time': 1774861361.388813, 'auction_closing_time': 1774970823.0}
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TX80167') HTTP/1.1" 204 0
2026-03-30 09:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_e8b5584a90a002aa86191091a9b7d949.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_8f2401bbdcb07777d5aff90bc8d3ec39.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7188376f-2d45-58b9-a4e2-fd7687b09d0b with identifier: LX93487
2026-03-30 09:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7188376f-2d45-58b9-a4e2-fd7687b09d0b with identifier: LX93487
2026-03-30 09:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7188376f-2d45-58b9-a4e2-fd7687b09d0b with identifier: LX93487 to the API
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:01:35Z',
 'fuel_type': 'petrol',
 'id': '7188376f-2d45-58b9-a4e2-fd7687b09d0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX93487',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 265116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-31',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2011}
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX93487%27 HTTP/1.1" 200 None
2026-03-30 09:02:41 [auto1.it] INFO: Saving data for LX93487: {'auction_closing_time': 1774969295.0, 'created_time': 1773936453.429362, 'last_price_update_time': 1774861361.777712}
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX93487') HTTP/1.1" 204 0
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_b2ec5701fced2fa0fbbd90d2a20f9dd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_b2ec5701fced2fa0fbbd90d2a20f9dd5.jpg not downloaded yet
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_3c53a69caef259c7ea492f65363e7b42.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_3c53a69caef259c7ea492f65363e7b42.jpg not downloaded yet
2026-03-30 09:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e91a50>
2026-03-30 09:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6774c04b-8b8a-5da1-ab3d-291bf0391fe1/6774c04b-8b8a-5da1-ab3d-291bf0391fe1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F92%252F5f920d05e0ee3bd323e438b87c6ed6e1%252Fpa%252FDP93203_1869916f1bcba20dfd8f4fd235561e3a.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_1869916f1bcba20dfd8f4fd235561e3a.jpg saved to cache
2026-03-30 09:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6774c04b-8b8a-5da1-ab3d-291bf0391fe1
2026-03-30 09:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6774c04b-8b8a-5da1-ab3d-291bf0391fe1, skipping ID generation
2026-03-30 09:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6774c04b-8b8a-5da1-ab3d-291bf0391fe1 with scrape type 1
2026-03-30 09:02:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6774c04b-8b8a-5da1-ab3d-291bf0391fe1 sending to next pipeline
2026-03-30 09:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6774c04b-8b8a-5da1-ab3d-291bf0391fe1, identifier: DP93203
2026-03-30 09:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_c0a210b1fd149ea0ecf4bbf7a8478457.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:41 [auto1.it] INFO: Found listing with ID: LZ42897
2026-03-30 09:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ42897%27 HTTP/1.1" 200 None
2026-03-30 09:02:42 [auto1.it] INFO: Scrape type for LZ42897: 2
2026-03-30 09:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d29e2b76-51c5-59e1-955c-c157918a777b with identifier: LZ42897
2026-03-30 09:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d29e2b76-51c5-59e1-955c-c157918a777b with scrape type 2
2026-03-30 09:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d29e2b76-51c5-59e1-955c-c157918a777b with scrape type 2
2026-03-30 09:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d29e2b76-51c5-59e1-955c-c157918a777b, identifier: LZ42897
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_2748437cbab8017d63c37f882c3c1a4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_2748437cbab8017d63c37f882c3c1a4c.jpg not downloaded yet
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc4%252F5bc49a628e55b53fa9fa9543d4c00524%252Fpa%252FSV41912_9c3d274480fe9e8ddc5cbc5fd3424587.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_9c3d274480fe9e8ddc5cbc5fd3424587.jpg not downloaded yet
2026-03-30 09:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH42786/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE87600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK64224/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6774c04b-8b8a-5da1-ab3d-291bf0391fe1 with identifier: DP93203
2026-03-30 09:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6774c04b-8b8a-5da1-ab3d-291bf0391fe1 with identifier: DP93203
2026-03-30 09:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6774c04b-8b8a-5da1-ab3d-291bf0391fe1 with identifier: DP93203 to the API
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_1869916f1bcba20dfd8f4fd235561e3a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:56:57Z',
 'fuel_type': 'petrol',
 'id': '6774c04b-8b8a-5da1-ab3d-291bf0391fe1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP93203',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 145471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6774c04b-8b8a-5da1-ab3d-291bf0391fe1/6774c04b-8b8a-5da1-ab3d-291bf0391fe1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_1869916f1bcba20dfd8f4fd235561e3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6774c04b-8b8a-5da1-ab3d-291bf0391fe1/6774c04b-8b8a-5da1-ab3d-291bf0391fe1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_938e5087508a21e19741e9aba08b3a52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6774c04b-8b8a-5da1-ab3d-291bf0391fe1/6774c04b-8b8a-5da1-ab3d-291bf0391fe1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_bd1ae7ca6e98badb849a1e98883cbafd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6774c04b-8b8a-5da1-ab3d-291bf0391fe1/6774c04b-8b8a-5da1-ab3d-291bf0391fe1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_f2c03bfcc814055128e56141bc110a11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6774c04b-8b8a-5da1-ab3d-291bf0391fe1/6774c04b-8b8a-5da1-ab3d-291bf0391fe1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/92/5f920d05e0ee3bd323e438b87c6ed6e1/pa/DP93203_eea776690d296d68bf6e778d138d053c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-10-12',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP93203%27 HTTP/1.1" 200 None
2026-03-30 09:02:42 [auto1.it] INFO: Saving data for DP93203: {'created_time': 1774861362.559123, 'last_price_update_time': 1774861362.559134, 'auction_closing_time': 1774972617.0}
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP93203') HTTP/1.1" 204 0
2026-03-30 09:02:42 [auto1.it] INFO: Channel: 24h | Page: 11 | totalHits: 3292 | hits on page: 40
2026-03-30 09:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d29e2b76-51c5-59e1-955c-c157918a777b with identifier: LZ42897
2026-03-30 09:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d29e2b76-51c5-59e1-955c-c157918a777b with identifier: LZ42897
2026-03-30 09:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d29e2b76-51c5-59e1-955c-c157918a777b with identifier: LZ42897 to the API
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:03:01Z',
 'fuel_type': 'diesel',
 'id': 'd29e2b76-51c5-59e1-955c-c157918a777b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ42897',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 220528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-31',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ42897%27 HTTP/1.1" 200 None
2026-03-30 09:02:42 [auto1.it] INFO: Saving data for LZ42897: {'auction_closing_time': 1774969381.0, 'created_time': 1774386554.799509, 'last_price_update_time': 1774861362.966818}
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LZ42897') HTTP/1.1" 204 0
2026-03-30 09:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_9c84d03095e2c36a0969eaa76f3f602b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_9c84d03095e2c36a0969eaa76f3f602b.jpg not downloaded yet
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_64f55137b91e2b7bb43e55720b73d250.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_64f55137b91e2b7bb43e55720b73d250.jpg not downloaded yet
2026-03-30 09:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_f23409d5b70a59199bd9baf760cae375.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:43 [auto1.it] INFO: Found listing with ID: SE28120
2026-03-30 09:02:43 [auto1.it] INFO: Found listing with ID: WV68321
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV68321%27 HTTP/1.1" 200 None
2026-03-30 09:02:43 [auto1.it] INFO: Scrape type for WV68321: 2
2026-03-30 09:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 724b5bee-3626-573d-b3ee-a58451e0a65b with identifier: WV68321
2026-03-30 09:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 724b5bee-3626-573d-b3ee-a58451e0a65b with scrape type 2
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 724b5bee-3626-573d-b3ee-a58451e0a65b with scrape type 2
2026-03-30 09:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 724b5bee-3626-573d-b3ee-a58451e0a65b, identifier: WV68321
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_99e0fc0624d53c067e150559286552b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_99e0fc0624d53c067e150559286552b2.jpg not downloaded yet
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc4%252F5bc49a628e55b53fa9fa9543d4c00524%252Fpa%252FSV41912_f7950747e783e12b2aee9c919bb73e83.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_f7950747e783e12b2aee9c919bb73e83.jpg not downloaded yet
2026-03-30 09:02:43 [auto1.it] INFO: Found listing with ID: YY05458
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY05458%27 HTTP/1.1" 200 None
2026-03-30 09:02:43 [auto1.it] INFO: Scrape type for YY05458: 2
2026-03-30 09:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a32b000-25b6-570c-9ef0-89643ea4b54a with identifier: YY05458
2026-03-30 09:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a32b000-25b6-570c-9ef0-89643ea4b54a with scrape type 2
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a32b000-25b6-570c-9ef0-89643ea4b54a with scrape type 2
2026-03-30 09:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1a32b000-25b6-570c-9ef0-89643ea4b54a, identifier: YY05458
2026-03-30 09:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062cc950>
2026-03-30 09:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_40aa1072fc2af8849685b457c7e7d2e6.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_40aa1072fc2af8849685b457c7e7d2e6.jpg saved to cache
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42
2026-03-30 09:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cac090>
2026-03-30 09:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_e8b5584a90a002aa86191091a9b7d949.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_e8b5584a90a002aa86191091a9b7d949.jpg saved to cache
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b767cebb-7d47-58e7-bed7-591a8c61d7d3
2026-03-30 09:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0617dcd0>
2026-03-30 09:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b5115d-0763-5fa7-9224-5ab626f7aed2/c6b5115d-0763-5fa7-9224-5ab626f7aed2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc4%252F5bc49a628e55b53fa9fa9543d4c00524%252Fpa%252FSV41912_8f2401bbdcb07777d5aff90bc8d3ec39.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_8f2401bbdcb07777d5aff90bc8d3ec39.jpg saved to cache
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6b5115d-0763-5fa7-9224-5ab626f7aed2
2026-03-30 09:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_a190697f2f90e999fc9742c14e368a31.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 724b5bee-3626-573d-b3ee-a58451e0a65b with identifier: WV68321
2026-03-30 09:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 724b5bee-3626-573d-b3ee-a58451e0a65b with identifier: WV68321
2026-03-30 09:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 724b5bee-3626-573d-b3ee-a58451e0a65b with identifier: WV68321 to the API
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:27:20Z',
 'fuel_type': 'petrol',
 'id': '724b5bee-3626-573d-b3ee-a58451e0a65b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV68321',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 92967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-22',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2012}
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV68321%27 HTTP/1.1" 200 None
2026-03-30 09:02:43 [auto1.it] INFO: Saving data for WV68321: {'auction_closing_time': 1774970840.0, 'created_time': 1774472526.874555, 'last_price_update_time': 1774861363.79122}
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WV68321') HTTP/1.1" 204 0
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_f76629dc093f48b382ca43ea57cf9c73.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_f76629dc093f48b382ca43ea57cf9c73.jpg not downloaded yet
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_bffbc21b52d1c86f4d074e90a476c6cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_bffbc21b52d1c86f4d074e90a476c6cb.jpg not downloaded yet
2026-03-30 09:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1a32b000-25b6-570c-9ef0-89643ea4b54a with identifier: YY05458
2026-03-30 09:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1a32b000-25b6-570c-9ef0-89643ea4b54a with identifier: YY05458
2026-03-30 09:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1a32b000-25b6-570c-9ef0-89643ea4b54a with identifier: YY05458 to the API
2026-03-30 09:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:51:26Z',
 'fuel_type': 'diesel',
 'id': '1a32b000-25b6-570c-9ef0-89643ea4b54a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY05458',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 265065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-12',
 'seller_name': None,
 'title': 'Honda CR-V 1.6 DTEC Elegance 2WD',
 'transmission': 'manual',
 'trim': 'Elegance 2WD',
 'year': 2015}
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY05458%27 HTTP/1.1" 200 None
2026-03-30 09:02:44 [auto1.it] INFO: Saving data for YY05458: {'auction_closing_time': 1774972286.0, 'created_time': 1772265694.069303, 'last_price_update_time': 1774861364.211437}
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY05458') HTTP/1.1" 204 0
2026-03-30 09:02:44 [auto1.it] INFO: Found listing with ID: ZK24441
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK24441%27 HTTP/1.1" 200 None
2026-03-30 09:02:44 [auto1.it] INFO: Scrape type for ZK24441: 2
2026-03-30 09:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d85e2162-c660-578e-9f7a-373f75afa5b9 with identifier: ZK24441
2026-03-30 09:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85e2162-c660-578e-9f7a-373f75afa5b9 with scrape type 2
2026-03-30 09:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d85e2162-c660-578e-9f7a-373f75afa5b9 with scrape type 2
2026-03-30 09:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d85e2162-c660-578e-9f7a-373f75afa5b9, identifier: ZK24441
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_7d8ea891df8e2f16acc4551d27490640.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_7d8ea891df8e2f16acc4551d27490640.jpg not downloaded yet
2026-03-30 09:02:44 [auto1.it] INFO: Found listing with ID: PT71441
2026-03-30 09:02:44 [auto1.it] INFO: Found listing with ID: DZ81200
2026-03-30 09:02:44 [auto1.it] INFO: Found listing with ID: BJ35164
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ35164%27 HTTP/1.1" 200 None
2026-03-30 09:02:44 [auto1.it] INFO: Scrape type for BJ35164: 2
2026-03-30 09:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4db4f238-ffb5-5c42-a0e0-c7b9f158e483 with identifier: BJ35164
2026-03-30 09:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4db4f238-ffb5-5c42-a0e0-c7b9f158e483 with scrape type 2
2026-03-30 09:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4db4f238-ffb5-5c42-a0e0-c7b9f158e483 with scrape type 2
2026-03-30 09:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4db4f238-ffb5-5c42-a0e0-c7b9f158e483, identifier: BJ35164
2026-03-30 09:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ce30d0>
2026-03-30 09:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F19%252Fe0193b3f9499b4a22760bfeec2ef3192%252Fpa%252FPF04390_c0a210b1fd149ea0ecf4bbf7a8478457.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_c0a210b1fd149ea0ecf4bbf7a8478457.jpg saved to cache
2026-03-30 09:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 905b485c-0fa3-5fcf-9211-e634367836fb
2026-03-30 09:02:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 905b485c-0fa3-5fcf-9211-e634367836fb, skipping ID generation
2026-03-30 09:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 905b485c-0fa3-5fcf-9211-e634367836fb with scrape type 1
2026-03-30 09:02:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 905b485c-0fa3-5fcf-9211-e634367836fb sending to next pipeline
2026-03-30 09:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 905b485c-0fa3-5fcf-9211-e634367836fb, identifier: PF04390
2026-03-30 09:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d85e2162-c660-578e-9f7a-373f75afa5b9 with identifier: ZK24441
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 09:02:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d85e2162-c660-578e-9f7a-373f75afa5b9 with identifier: ZK24441
2026-03-30 09:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d85e2162-c660-578e-9f7a-373f75afa5b9 with identifier: ZK24441 to the API
2026-03-30 09:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 52,
 'expiration_date': '2026-03-31T15:20:16Z',
 'fuel_type': 'petrol',
 'id': 'd85e2162-c660-578e-9f7a-373f75afa5b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK24441',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Matiz',
 'odometer': 65695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-27',
 'seller_name': None,
 'title': 'Chevrolet Matiz 0.8 AT',
 'transmission': 'automatic',
 'trim': 'AT',
 'year': 2007}
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK24441%27 HTTP/1.1" 200 None
2026-03-30 09:02:45 [auto1.it] INFO: Saving data for ZK24441: {'auction_closing_time': 1774970416.0, 'created_time': 1774342968.741318, 'last_price_update_time': 1774861365.173632}
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZK24441') HTTP/1.1" 204 0
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_8f31f2a4d337c3afc00f0212734b40ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_8f31f2a4d337c3afc00f0212734b40ae.jpg not downloaded yet
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_7e2ac68db0ed1e79834d078e6000147b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_7e2ac68db0ed1e79834d078e6000147b.jpg not downloaded yet
2026-03-30 09:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4db4f238-ffb5-5c42-a0e0-c7b9f158e483 with identifier: BJ35164
2026-03-30 09:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4db4f238-ffb5-5c42-a0e0-c7b9f158e483 with identifier: BJ35164
2026-03-30 09:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4db4f238-ffb5-5c42-a0e0-c7b9f158e483 with identifier: BJ35164 to the API
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:49:46Z',
 'fuel_type': 'petrol',
 'id': '4db4f238-ffb5-5c42-a0e0-c7b9f158e483',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ35164',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 141008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-31',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ35164%27 HTTP/1.1" 200 None
2026-03-30 09:02:45 [auto1.it] INFO: Saving data for BJ35164: {'auction_closing_time': 1774972186.0, 'created_time': 1773835664.413011, 'last_price_update_time': 1774861365.56452}
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ35164') HTTP/1.1" 204 0
2026-03-30 09:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 905b485c-0fa3-5fcf-9211-e634367836fb with identifier: PF04390
2026-03-30 09:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 905b485c-0fa3-5fcf-9211-e634367836fb with identifier: PF04390
2026-03-30 09:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 905b485c-0fa3-5fcf-9211-e634367836fb with identifier: PF04390 to the API
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_c0a210b1fd149ea0ecf4bbf7a8478457.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:52:21Z',
 'fuel_type': 'petrol',
 'id': '905b485c-0fa3-5fcf-9211-e634367836fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF04390',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 154468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 881523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_18af8768db3c4b66470834474bb65a4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 881523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_a4716d668dc2de1072577912f425901c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1079961,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_67900bd255907cd4ee58a4f171f920dc.jpg',
             'Width': 1917},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 860874,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_26256165a0fea9aa78b1e6934e0b3133.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1098168,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_c0a210b1fd149ea0ecf4bbf7a8478457.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1141363,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_cfe6690abd508fc59e139f03029ff22f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715792,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_e88771ca1650d7d7b17594ea15649487.jpg',
             'Width': 1621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 858436,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_5dc3e59bfa2a43dfb88fe13fcd32eb6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 876520,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_96107a934f6aa0a6785b2522a63dda6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_905b485c-0fa3-5fcf-9211-e634367836fb/905b485c-0fa3-5fcf-9211-e634367836fb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 915981,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/19/e0193b3f9499b4a22760bfeec2ef3192/pa/PF04390_89c6065d9cf2d1ca6c11caa769f4c0e2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Adam 1.2 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2015}
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF04390%27 HTTP/1.1" 200 None
2026-03-30 09:02:45 [auto1.it] INFO: Saving data for PF04390: {'created_time': 1774861365.971353, 'last_price_update_time': 1774861365.971364, 'auction_closing_time': 1774972341.0}
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PF04390') HTTP/1.1" 204 0
2026-03-30 09:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0617f350>
2026-03-30 09:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_f23409d5b70a59199bd9baf760cae375.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_f23409d5b70a59199bd9baf760cae375.jpg saved to cache
2026-03-30 09:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b767cebb-7d47-58e7-bed7-591a8c61d7d3
2026-03-30 09:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_3008aa2b4b943c52ff0b5194110ba55a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:46 [auto1.it] INFO: Found listing with ID: GW20152
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW20152%27 HTTP/1.1" 200 None
2026-03-30 09:02:46 [auto1.it] INFO: Scrape type for GW20152: 1
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_bd315e32fe2e132b22ef9db63ab62b38.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_bd315e32fe2e132b22ef9db63ab62b38.jpg not downloaded yet
2026-03-30 09:02:46 [auto1.it] INFO: Found listing with ID: SJ10384
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ10384%27 HTTP/1.1" 200 None
2026-03-30 09:02:46 [auto1.it] INFO: Scrape type for SJ10384: 2
2026-03-30 09:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9739e571-5449-5d05-acba-3906602c03df with identifier: SJ10384
2026-03-30 09:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9739e571-5449-5d05-acba-3906602c03df with scrape type 2
2026-03-30 09:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9739e571-5449-5d05-acba-3906602c03df with scrape type 2
2026-03-30 09:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9739e571-5449-5d05-acba-3906602c03df, identifier: SJ10384
2026-03-30 09:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_fbc3dd555a610142dc5f2a548b042f2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_bae66a4de7db4b88e429a7e5f3a0f9a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_bae66a4de7db4b88e429a7e5f3a0f9a0.jpg not downloaded yet
2026-03-30 09:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9739e571-5449-5d05-acba-3906602c03df with identifier: SJ10384
2026-03-30 09:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9739e571-5449-5d05-acba-3906602c03df with identifier: SJ10384
2026-03-30 09:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9739e571-5449-5d05-acba-3906602c03df with identifier: SJ10384 to the API
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:07:16Z',
 'fuel_type': 'diesel',
 'id': '9739e571-5449-5d05-acba-3906602c03df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ10384',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 219323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-04',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.6 JTD Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2009}
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ10384%27 HTTP/1.1" 200 None
2026-03-30 09:02:46 [auto1.it] INFO: Saving data for SJ10384: {'auction_closing_time': 1774969636.0, 'created_time': 1773232637.344574, 'last_price_update_time': 1774861366.577508}
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SJ10384') HTTP/1.1" 204 0
2026-03-30 09:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ15819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06eabf90>
2026-03-30 09:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_a190697f2f90e999fc9742c14e368a31.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_a190697f2f90e999fc9742c14e368a31.jpg saved to cache
2026-03-30 09:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b767cebb-7d47-58e7-bed7-591a8c61d7d3
2026-03-30 09:02:46 [auto1.it] INFO: Found listing with ID: UL18238
2026-03-30 09:02:46 [auto1.it] INFO: Found listing with ID: FW39632
2026-03-30 09:02:46 [auto1.it] INFO: Found listing with ID: PE82748
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE82748%27 HTTP/1.1" 200 None
2026-03-30 09:02:46 [auto1.it] INFO: Scrape type for PE82748: 2
2026-03-30 09:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7050c59-6ba8-5b5b-975c-38c325c1c6d6 with identifier: PE82748
2026-03-30 09:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7050c59-6ba8-5b5b-975c-38c325c1c6d6 with scrape type 2
2026-03-30 09:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7050c59-6ba8-5b5b-975c-38c325c1c6d6 with scrape type 2
2026-03-30 09:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7050c59-6ba8-5b5b-975c-38c325c1c6d6, identifier: PE82748
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_e56039c97cfa6e8dfedca70a9eff7e49.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_e56039c97cfa6e8dfedca70a9eff7e49.jpg not downloaded yet
2026-03-30 09:02:46 [auto1.it] INFO: Found listing with ID: PL88516
2026-03-30 09:02:46 [auto1.it] INFO: Found listing with ID: SC57699
2026-03-30 09:02:46 [auto1.it] INFO: Found listing with ID: UY23152
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY23152%27 HTTP/1.1" 200 None
2026-03-30 09:02:46 [auto1.it] INFO: Scrape type for UY23152: 2
2026-03-30 09:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dae43c4-aaef-56b5-8674-53e840da4759 with identifier: UY23152
2026-03-30 09:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dae43c4-aaef-56b5-8674-53e840da4759 with scrape type 2
2026-03-30 09:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dae43c4-aaef-56b5-8674-53e840da4759 with scrape type 2
2026-03-30 09:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7dae43c4-aaef-56b5-8674-53e840da4759, identifier: UY23152
2026-03-30 09:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7050c59-6ba8-5b5b-975c-38c325c1c6d6 with identifier: PE82748
2026-03-30 09:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7050c59-6ba8-5b5b-975c-38c325c1c6d6 with identifier: PE82748
2026-03-30 09:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b7050c59-6ba8-5b5b-975c-38c325c1c6d6 with identifier: PE82748 to the API
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:13:56Z',
 'fuel_type': 'gas',
 'id': 'b7050c59-6ba8-5b5b-975c-38c325c1c6d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE82748',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 130662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-14',
 'seller_name': None,
 'title': 'Fiat Panda 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2013}
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE82748%27 HTTP/1.1" 200 None
2026-03-30 09:02:47 [auto1.it] INFO: Saving data for PE82748: {'auction_closing_time': 1774970036.0, 'created_time': 1773267264.674906, 'last_price_update_time': 1774861367.370194}
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PE82748') HTTP/1.1" 204 0
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_bb616d0ab612cc63d29eda36fa6c3751.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_bb616d0ab612cc63d29eda36fa6c3751.jpg not downloaded yet
2026-03-30 09:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7dae43c4-aaef-56b5-8674-53e840da4759 with identifier: UY23152
2026-03-30 09:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7dae43c4-aaef-56b5-8674-53e840da4759 with identifier: UY23152
2026-03-30 09:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7dae43c4-aaef-56b5-8674-53e840da4759 with identifier: UY23152 to the API
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:05:52Z',
 'fuel_type': 'gas',
 'id': '7dae43c4-aaef-56b5-8674-53e840da4759',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY23152',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 195502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-26',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2017}
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY23152%27 HTTP/1.1" 200 None
2026-03-30 09:02:47 [auto1.it] INFO: Saving data for UY23152: {'auction_closing_time': 1774969552.0, 'created_time': 1773231692.762605, 'last_price_update_time': 1774861367.785529}
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UY23152') HTTP/1.1" 204 0
2026-03-30 09:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061d4150>
2026-03-30 09:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b5115d-0763-5fa7-9224-5ab626f7aed2/c6b5115d-0763-5fa7-9224-5ab626f7aed2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc4%252F5bc49a628e55b53fa9fa9543d4c00524%252Fpa%252FSV41912_3008aa2b4b943c52ff0b5194110ba55a.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_3008aa2b4b943c52ff0b5194110ba55a.jpg saved to cache
2026-03-30 09:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6b5115d-0763-5fa7-9224-5ab626f7aed2
2026-03-30 09:02:47 [auto1.it] INFO: Found listing with ID: YY05458
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY05458%27 HTTP/1.1" 200 None
2026-03-30 09:02:47 [auto1.it] INFO: Scrape type for YY05458: 0
2026-03-30 09:02:47 [auto1.it] INFO: Found listing with ID: PT71441
2026-03-30 09:02:47 [auto1.it] INFO: Found listing with ID: DZ81200
2026-03-30 09:02:47 [auto1.it] INFO: Found listing with ID: BJ35164
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ35164%27 HTTP/1.1" 200 None
2026-03-30 09:02:47 [auto1.it] INFO: Scrape type for BJ35164: 0
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_183d3c150924b1087b74ead5abb34083.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_183d3c150924b1087b74ead5abb34083.jpg not downloaded yet
2026-03-30 09:02:47 [auto1.it] INFO: Found listing with ID: RK33520
2026-03-30 09:02:47 [auto1.it] INFO: Found listing with ID: UP66451
2026-03-30 09:02:47 [auto1.it] INFO: Found listing with ID: AE31904
2026-03-30 09:02:47 [auto1.it] INFO: Found listing with ID: YD69263
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD69263%27 HTTP/1.1" 200 None
2026-03-30 09:02:47 [auto1.it] INFO: Scrape type for YD69263: 2
2026-03-30 09:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77a9c30e-fc25-5987-8d0e-873efda1d42d with identifier: YD69263
2026-03-30 09:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77a9c30e-fc25-5987-8d0e-873efda1d42d with scrape type 2
2026-03-30 09:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77a9c30e-fc25-5987-8d0e-873efda1d42d with scrape type 2
2026-03-30 09:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 77a9c30e-fc25-5987-8d0e-873efda1d42d, identifier: YD69263
2026-03-30 09:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dbf9d0>
2026-03-30 09:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_fbc3dd555a610142dc5f2a548b042f2d.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_fbc3dd555a610142dc5f2a548b042f2d.jpg saved to cache
2026-03-30 09:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b767cebb-7d47-58e7-bed7-591a8c61d7d3
2026-03-30 09:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_d8ebf823ba405d262927b54c1aa0ac43.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 77a9c30e-fc25-5987-8d0e-873efda1d42d with identifier: YD69263
2026-03-30 09:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 77a9c30e-fc25-5987-8d0e-873efda1d42d with identifier: YD69263
2026-03-30 09:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 77a9c30e-fc25-5987-8d0e-873efda1d42d with identifier: YD69263 to the API
2026-03-30 09:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-31T15:38:42Z',
 'fuel_type': 'diesel',
 'id': '77a9c30e-fc25-5987-8d0e-873efda1d42d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD69263',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 154900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-30',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 2.0 Blue-HDi Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2020}
2026-03-30 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD69263%27 HTTP/1.1" 200 None
2026-03-30 09:02:48 [auto1.it] INFO: Saving data for YD69263: {'auction_closing_time': 1774971522.0, 'created_time': 1774353670.935028, 'last_price_update_time': 1774861368.587731}
2026-03-30 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YD69263') HTTP/1.1" 204 0
2026-03-30 09:02:48 [auto1.it] INFO: Found listing with ID: ZR63557
2026-03-30 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR63557%27 HTTP/1.1" 200 None
2026-03-30 09:02:48 [auto1.it] INFO: Scrape type for ZR63557: 2
2026-03-30 09:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2032d5f9-1ee3-51f3-bde7-61a13f64085c with identifier: ZR63557
2026-03-30 09:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2032d5f9-1ee3-51f3-bde7-61a13f64085c with scrape type 2
2026-03-30 09:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2032d5f9-1ee3-51f3-bde7-61a13f64085c with scrape type 2
2026-03-30 09:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2032d5f9-1ee3-51f3-bde7-61a13f64085c, identifier: ZR63557
2026-03-30 09:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2032d5f9-1ee3-51f3-bde7-61a13f64085c with identifier: ZR63557
2026-03-30 09:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2032d5f9-1ee3-51f3-bde7-61a13f64085c with identifier: ZR63557
2026-03-30 09:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2032d5f9-1ee3-51f3-bde7-61a13f64085c with identifier: ZR63557 to the API
2026-03-30 09:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:19:57Z',
 'fuel_type': 'hybrid',
 'id': '2032d5f9-1ee3-51f3-bde7-61a13f64085c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR63557',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 96972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR63557%27 HTTP/1.1" 200 None
2026-03-30 09:02:49 [auto1.it] INFO: Saving data for ZR63557: {'auction_closing_time': 1774970397.0, 'created_time': 1773694839.028934, 'last_price_update_time': 1774861369.211418}
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZR63557') HTTP/1.1" 204 0
2026-03-30 09:02:49 [auto1.it] INFO: Found listing with ID: ZH41426
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH41426%27 HTTP/1.1" 200 None
2026-03-30 09:02:49 [auto1.it] INFO: Scrape type for ZH41426: 2
2026-03-30 09:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cefffba7-7042-5caf-be7a-e4eed14f13be with identifier: ZH41426
2026-03-30 09:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cefffba7-7042-5caf-be7a-e4eed14f13be with scrape type 2
2026-03-30 09:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cefffba7-7042-5caf-be7a-e4eed14f13be with scrape type 2
2026-03-30 09:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cefffba7-7042-5caf-be7a-e4eed14f13be, identifier: ZH41426
2026-03-30 09:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e19563310>
2026-03-30 09:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b5115d-0763-5fa7-9224-5ab626f7aed2/c6b5115d-0763-5fa7-9224-5ab626f7aed2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc4%252F5bc49a628e55b53fa9fa9543d4c00524%252Fpa%252FSV41912_d8ebf823ba405d262927b54c1aa0ac43.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_d8ebf823ba405d262927b54c1aa0ac43.jpg saved to cache
2026-03-30 09:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6b5115d-0763-5fa7-9224-5ab626f7aed2
2026-03-30 09:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_9c3d274480fe9e8ddc5cbc5fd3424587.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cefffba7-7042-5caf-be7a-e4eed14f13be with identifier: ZH41426
2026-03-30 09:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cefffba7-7042-5caf-be7a-e4eed14f13be with identifier: ZH41426
2026-03-30 09:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cefffba7-7042-5caf-be7a-e4eed14f13be with identifier: ZH41426 to the API
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:43:42Z',
 'fuel_type': 'diesel',
 'id': 'cefffba7-7042-5caf-be7a-e4eed14f13be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH41426',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 153156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Energy 2WD',
 'transmission': 'automatic',
 'trim': 'Energy 2WD',
 'year': 2019}
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH41426%27 HTTP/1.1" 200 None
2026-03-30 09:02:49 [auto1.it] INFO: Saving data for ZH41426: {'auction_closing_time': 1774971822.0, 'created_time': 1773241798.02805, 'last_price_update_time': 1774861369.881415}
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH41426') HTTP/1.1" 204 0
2026-03-30 09:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:49 [auto1.it] INFO: Found listing with ID: EB41992
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB41992%27 HTTP/1.1" 200 None
2026-03-30 09:02:49 [auto1.it] INFO: Scrape type for EB41992: 2
2026-03-30 09:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a94faca-51f3-5d33-93bd-ec3029473a4d with identifier: EB41992
2026-03-30 09:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a94faca-51f3-5d33-93bd-ec3029473a4d with scrape type 2
2026-03-30 09:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a94faca-51f3-5d33-93bd-ec3029473a4d with scrape type 2
2026-03-30 09:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5a94faca-51f3-5d33-93bd-ec3029473a4d, identifier: EB41992
2026-03-30 09:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5a94faca-51f3-5d33-93bd-ec3029473a4d with identifier: EB41992
2026-03-30 09:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5a94faca-51f3-5d33-93bd-ec3029473a4d with identifier: EB41992
2026-03-30 09:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5a94faca-51f3-5d33-93bd-ec3029473a4d with identifier: EB41992 to the API
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:08:23Z',
 'fuel_type': 'diesel',
 'id': '5a94faca-51f3-5d33-93bd-ec3029473a4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB41992',
 'listing': 'auction',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 174920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-11',
 'seller_name': None,
 'title': 'Iveco Daily 2.3 Diesel HKa 35 S V Radstand 3520 L',
 'transmission': 'manual',
 'trim': 'HKa 35 S V Radstand 3520 L',
 'year': 2017}
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB41992%27 HTTP/1.1" 200 None
2026-03-30 09:02:50 [auto1.it] INFO: Saving data for EB41992: {'auction_closing_time': 1774969703.0, 'created_time': 1772784355.328497, 'last_price_update_time': 1774861370.37281}
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EB41992') HTTP/1.1" 204 0
2026-03-30 09:02:50 [auto1.it] INFO: Found listing with ID: ZU58550
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU58550%27 HTTP/1.1" 200 None
2026-03-30 09:02:50 [auto1.it] INFO: Scrape type for ZU58550: 2
2026-03-30 09:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d186b9b-1f80-50c8-86f3-ef3a9d70189b with identifier: ZU58550
2026-03-30 09:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d186b9b-1f80-50c8-86f3-ef3a9d70189b with scrape type 2
2026-03-30 09:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d186b9b-1f80-50c8-86f3-ef3a9d70189b with scrape type 2
2026-03-30 09:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d186b9b-1f80-50c8-86f3-ef3a9d70189b, identifier: ZU58550
2026-03-30 09:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d186b9b-1f80-50c8-86f3-ef3a9d70189b with identifier: ZU58550
2026-03-30 09:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d186b9b-1f80-50c8-86f3-ef3a9d70189b with identifier: ZU58550
2026-03-30 09:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d186b9b-1f80-50c8-86f3-ef3a9d70189b with identifier: ZU58550 to the API
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:07:32Z',
 'fuel_type': 'diesel',
 'id': '9d186b9b-1f80-50c8-86f3-ef3a9d70189b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU58550',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 141517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU58550%27 HTTP/1.1" 200 None
2026-03-30 09:02:50 [auto1.it] INFO: Saving data for ZU58550: {'auction_closing_time': 1774969652.0, 'created_time': 1774472468.720571, 'last_price_update_time': 1774861370.856423}
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU58550') HTTP/1.1" 204 0
2026-03-30 09:02:50 [auto1.it] INFO: Found listing with ID: BF27617
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF27617%27 HTTP/1.1" 200 None
2026-03-30 09:02:50 [auto1.it] INFO: Scrape type for BF27617: 2
2026-03-30 09:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b809f158-bd08-53a9-b7b2-1a84c46083b6 with identifier: BF27617
2026-03-30 09:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b809f158-bd08-53a9-b7b2-1a84c46083b6 with scrape type 2
2026-03-30 09:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b809f158-bd08-53a9-b7b2-1a84c46083b6 with scrape type 2
2026-03-30 09:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b809f158-bd08-53a9-b7b2-1a84c46083b6, identifier: BF27617
2026-03-30 09:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fcda10>
2026-03-30 09:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b5115d-0763-5fa7-9224-5ab626f7aed2/c6b5115d-0763-5fa7-9224-5ab626f7aed2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc4%252F5bc49a628e55b53fa9fa9543d4c00524%252Fpa%252FSV41912_9c3d274480fe9e8ddc5cbc5fd3424587.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_9c3d274480fe9e8ddc5cbc5fd3424587.jpg saved to cache
2026-03-30 09:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6b5115d-0763-5fa7-9224-5ab626f7aed2
2026-03-30 09:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b809f158-bd08-53a9-b7b2-1a84c46083b6 with identifier: BF27617
2026-03-30 09:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b809f158-bd08-53a9-b7b2-1a84c46083b6 with identifier: BF27617
2026-03-30 09:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b809f158-bd08-53a9-b7b2-1a84c46083b6 with identifier: BF27617 to the API
2026-03-30 09:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:22:23Z',
 'fuel_type': 'petrol',
 'id': 'b809f158-bd08-53a9-b7b2-1a84c46083b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF27617',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 151813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-29',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.2 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2012}
2026-03-30 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF27617%27 HTTP/1.1" 200 None
2026-03-30 09:02:51 [auto1.it] INFO: Saving data for BF27617: {'auction_closing_time': 1774970543.0, 'created_time': 1774008037.877124, 'last_price_update_time': 1774861371.967002}
2026-03-30 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BF27617') HTTP/1.1" 204 0
2026-03-30 09:02:51 [auto1.it] INFO: Found listing with ID: WU44715
2026-03-30 09:02:51 [auto1.it] INFO: Found listing with ID: EN03820
2026-03-30 09:02:51 [auto1.it] INFO: Found listing with ID: GW95975
2026-03-30 09:02:51 [auto1.it] INFO: Found listing with ID: JE32624
2026-03-30 09:02:51 [auto1.it] INFO: Found listing with ID: VJ49724
2026-03-30 09:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ49724%27 HTTP/1.1" 200 None
2026-03-30 09:02:52 [auto1.it] INFO: Scrape type for VJ49724: 2
2026-03-30 09:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6266eed9-e088-55fb-b7bc-cdf89dff485b with identifier: VJ49724
2026-03-30 09:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6266eed9-e088-55fb-b7bc-cdf89dff485b with scrape type 2
2026-03-30 09:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6266eed9-e088-55fb-b7bc-cdf89dff485b with scrape type 2
2026-03-30 09:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6266eed9-e088-55fb-b7bc-cdf89dff485b, identifier: VJ49724
2026-03-30 09:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK43597> (referer: https://www.auto1.com/v1/car-details-view/DK43597/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6266eed9-e088-55fb-b7bc-cdf89dff485b with identifier: VJ49724
2026-03-30 09:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6266eed9-e088-55fb-b7bc-cdf89dff485b with identifier: VJ49724
2026-03-30 09:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6266eed9-e088-55fb-b7bc-cdf89dff485b with identifier: VJ49724 to the API
2026-03-30 09:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:50:38Z',
 'fuel_type': 'diesel',
 'id': '6266eed9-e088-55fb-b7bc-cdf89dff485b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ49724',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Hilux',
 'odometer': 84099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-02',
 'seller_name': None,
 'title': 'Toyota Hilux 2.8 D-4D Double Cab Executive 4x4',
 'transmission': 'automatic',
 'trim': 'Double Cab Executive 4x4',
 'year': 2022}
2026-03-30 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ49724%27 HTTP/1.1" 200 None
2026-03-30 09:02:52 [auto1.it] INFO: Saving data for VJ49724: {'auction_closing_time': 1774972238.0, 'created_time': 1773997429.115577, 'last_price_update_time': 1774861372.507673}
2026-03-30 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VJ49724') HTTP/1.1" 204 0
2026-03-30 09:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:52 [auto1.it] INFO: Found listing with ID: CM62235
2026-03-30 09:02:52 [auto1.it] INFO: Found listing with ID: NG07362
2026-03-30 09:02:52 [auto1.it] INFO: Found listing with ID: SK65228
2026-03-30 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK65228%27 HTTP/1.1" 200 None
2026-03-30 09:02:52 [auto1.it] INFO: Scrape type for SK65228: 2
2026-03-30 09:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25f74847-e6a8-5ff2-9d4d-79de1f06dbed with identifier: SK65228
2026-03-30 09:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25f74847-e6a8-5ff2-9d4d-79de1f06dbed with scrape type 2
2026-03-30 09:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25f74847-e6a8-5ff2-9d4d-79de1f06dbed with scrape type 2
2026-03-30 09:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 25f74847-e6a8-5ff2-9d4d-79de1f06dbed, identifier: SK65228
2026-03-30 09:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 25f74847-e6a8-5ff2-9d4d-79de1f06dbed with identifier: SK65228
2026-03-30 09:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 25f74847-e6a8-5ff2-9d4d-79de1f06dbed with identifier: SK65228
2026-03-30 09:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 25f74847-e6a8-5ff2-9d4d-79de1f06dbed with identifier: SK65228 to the API
2026-03-30 09:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:04:08Z',
 'fuel_type': 'diesel',
 'id': '25f74847-e6a8-5ff2-9d4d-79de1f06dbed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK65228',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 183897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-28',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2016}
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK65228%27 HTTP/1.1" 200 None
2026-03-30 09:02:53 [auto1.it] INFO: Saving data for SK65228: {'auction_closing_time': 1774969448.0, 'created_time': 1773651736.796167, 'last_price_update_time': 1774861373.260013}
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK65228') HTTP/1.1" 204 0
2026-03-30 09:02:53 [auto1.it] INFO: Found listing with ID: YY30219
2026-03-30 09:02:53 [auto1.it] INFO: Found listing with ID: CE85446
2026-03-30 09:02:53 [auto1.it] INFO: Found listing with ID: HU51059
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU51059%27 HTTP/1.1" 200 None
2026-03-30 09:02:53 [auto1.it] INFO: Scrape type for HU51059: 2
2026-03-30 09:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c85ecd92-5d54-5d28-89f5-24752b7b8eb1 with identifier: HU51059
2026-03-30 09:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c85ecd92-5d54-5d28-89f5-24752b7b8eb1 with scrape type 2
2026-03-30 09:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c85ecd92-5d54-5d28-89f5-24752b7b8eb1 with scrape type 2
2026-03-30 09:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c85ecd92-5d54-5d28-89f5-24752b7b8eb1, identifier: HU51059
2026-03-30 09:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c85ecd92-5d54-5d28-89f5-24752b7b8eb1 with identifier: HU51059
2026-03-30 09:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c85ecd92-5d54-5d28-89f5-24752b7b8eb1 with identifier: HU51059
2026-03-30 09:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c85ecd92-5d54-5d28-89f5-24752b7b8eb1 with identifier: HU51059 to the API
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:04:54Z',
 'fuel_type': 'diesel',
 'id': 'c85ecd92-5d54-5d28-89f5-24752b7b8eb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU51059',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 244350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-19',
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy XMOD',
 'transmission': 'manual',
 'trim': 'XMOD',
 'year': 2016}
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU51059%27 HTTP/1.1" 200 None
2026-03-30 09:02:53 [auto1.it] INFO: Saving data for HU51059: {'auction_closing_time': 1774969494.0, 'created_time': 1774386116.131447, 'last_price_update_time': 1774861373.817531}
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU51059') HTTP/1.1" 204 0
2026-03-30 09:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f with identifier: DK43597
2026-03-30 09:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f with scrape type 1
2026-03-30 09:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_6b94f5b015dd995ad556dfb6cc355829.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_6b94f5b015dd995ad556dfb6cc355829.jpg not downloaded yet
2026-03-30 09:02:53 [auto1.it] INFO: Channel: 24h | Page: 12 | totalHits: 3293 | hits on page: 40
2026-03-30 09:02:53 [auto1.it] INFO: Found listing with ID: XN46207
2026-03-30 09:02:53 [auto1.it] INFO: Found listing with ID: KM32276
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM32276%27 HTTP/1.1" 200 None
2026-03-30 09:02:53 [auto1.it] INFO: Scrape type for KM32276: 2
2026-03-30 09:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8417769d-fc38-56e3-a5ab-1b1329ee5dd0 with identifier: KM32276
2026-03-30 09:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8417769d-fc38-56e3-a5ab-1b1329ee5dd0 with scrape type 2
2026-03-30 09:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8417769d-fc38-56e3-a5ab-1b1329ee5dd0 with scrape type 2
2026-03-30 09:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8417769d-fc38-56e3-a5ab-1b1329ee5dd0, identifier: KM32276
2026-03-30 09:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ15819> (referer: https://www.auto1.com/v1/car-details-view/FJ15819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8417769d-fc38-56e3-a5ab-1b1329ee5dd0 with identifier: KM32276
2026-03-30 09:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8417769d-fc38-56e3-a5ab-1b1329ee5dd0 with identifier: KM32276
2026-03-30 09:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8417769d-fc38-56e3-a5ab-1b1329ee5dd0 with identifier: KM32276 to the API
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:01:38Z',
 'fuel_type': 'diesel',
 'id': '8417769d-fc38-56e3-a5ab-1b1329ee5dd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM32276',
 'listing': 'auction',
 'make': 'Isuzu',
 'model': 'D-MAX',
 'odometer': 39733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-03',
 'seller_name': None,
 'title': 'Isuzu D-MAX 1.9 Turbodiesel Double Cab 4WD L',
 'transmission': 'automatic',
 'trim': 'Double Cab 4WD L',
 'year': 2023}
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM32276%27 HTTP/1.1" 200 None
2026-03-30 09:02:54 [auto1.it] INFO: Saving data for KM32276: {'auction_closing_time': 1774969298.0, 'created_time': 1774472538.191393, 'last_price_update_time': 1774861374.398834}
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM32276') HTTP/1.1" 204 0
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_a90aaa85c4e1b3020e98ca761b302a57.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_a90aaa85c4e1b3020e98ca761b302a57.jpg not downloaded yet
2026-03-30 09:02:54 [auto1.it] INFO: Found listing with ID: KE18489
2026-03-30 09:02:54 [auto1.it] INFO: Found listing with ID: PX43587
2026-03-30 09:02:54 [auto1.it] INFO: Found listing with ID: CE26038
2026-03-30 09:02:54 [auto1.it] INFO: Found listing with ID: JR23231
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR23231%27 HTTP/1.1" 200 None
2026-03-30 09:02:54 [auto1.it] INFO: Scrape type for JR23231: 2
2026-03-30 09:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7d0175b-b9f9-547b-8950-e9b6042894fd with identifier: JR23231
2026-03-30 09:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7d0175b-b9f9-547b-8950-e9b6042894fd with scrape type 2
2026-03-30 09:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7d0175b-b9f9-547b-8950-e9b6042894fd with scrape type 2
2026-03-30 09:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c7d0175b-b9f9-547b-8950-e9b6042894fd, identifier: JR23231
2026-03-30 09:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:02:54 [auto1.it] INFO: Found listing with ID: WX63891
2026-03-30 09:02:54 [auto1.it] INFO: Found listing with ID: EN15125
2026-03-30 09:02:54 [auto1.it] INFO: Found listing with ID: PD42328
2026-03-30 09:02:54 [auto1.it] INFO: Found listing with ID: XT99009
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT99009%27 HTTP/1.1" 200 None
2026-03-30 09:02:54 [auto1.it] INFO: Scrape type for XT99009: 2
2026-03-30 09:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd616e74-d774-56c5-a11a-c7e5d1b88150 with identifier: XT99009
2026-03-30 09:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd616e74-d774-56c5-a11a-c7e5d1b88150 with scrape type 2
2026-03-30 09:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd616e74-d774-56c5-a11a-c7e5d1b88150 with scrape type 2
2026-03-30 09:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd616e74-d774-56c5-a11a-c7e5d1b88150, identifier: XT99009
2026-03-30 09:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c7d0175b-b9f9-547b-8950-e9b6042894fd with identifier: JR23231
2026-03-30 09:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c7d0175b-b9f9-547b-8950-e9b6042894fd with identifier: JR23231
2026-03-30 09:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c7d0175b-b9f9-547b-8950-e9b6042894fd with identifier: JR23231 to the API
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:31:22Z',
 'fuel_type': 'diesel',
 'id': 'c7d0175b-b9f9-547b-8950-e9b6042894fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR23231',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 282406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-31',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR23231%27 HTTP/1.1" 200 None
2026-03-30 09:02:55 [auto1.it] INFO: Saving data for JR23231: {'auction_closing_time': 1774971082.0, 'created_time': 1774353889.921598, 'last_price_update_time': 1774861375.089718}
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JR23231') HTTP/1.1" 204 0
2026-03-30 09:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd616e74-d774-56c5-a11a-c7e5d1b88150 with identifier: XT99009
2026-03-30 09:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd616e74-d774-56c5-a11a-c7e5d1b88150 with identifier: XT99009
2026-03-30 09:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd616e74-d774-56c5-a11a-c7e5d1b88150 with identifier: XT99009 to the API
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:04:33Z',
 'fuel_type': 'diesel',
 'id': 'dd616e74-d774-56c5-a11a-c7e5d1b88150',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT99009',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 470368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-03',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT99009%27 HTTP/1.1" 200 None
2026-03-30 09:02:55 [auto1.it] INFO: Saving data for XT99009: {'auction_closing_time': 1774969473.0, 'created_time': 1773231640.377685, 'last_price_update_time': 1774861375.612145}
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XT99009') HTTP/1.1" 204 0
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_5c3c54c24d86bdb912fcbba2e069f238.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_5c3c54c24d86bdb912fcbba2e069f238.jpg not downloaded yet
2026-03-30 09:02:55 [auto1.it] INFO: Found listing with ID: ZG72619
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG72619%27 HTTP/1.1" 200 None
2026-03-30 09:02:55 [auto1.it] INFO: Scrape type for ZG72619: 2
2026-03-30 09:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d32d4a69-7c67-5fd3-8355-fb11f70889ff with identifier: ZG72619
2026-03-30 09:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d32d4a69-7c67-5fd3-8355-fb11f70889ff with scrape type 2
2026-03-30 09:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d32d4a69-7c67-5fd3-8355-fb11f70889ff with scrape type 2
2026-03-30 09:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d32d4a69-7c67-5fd3-8355-fb11f70889ff, identifier: ZG72619
2026-03-30 09:02:55 [auto1.it] INFO: Found listing with ID: KD47428
2026-03-30 09:02:55 [auto1.it] INFO: Found listing with ID: EW53472
2026-03-30 09:02:55 [auto1.it] INFO: Found listing with ID: FB83790
2026-03-30 09:02:55 [auto1.it] INFO: Found listing with ID: HU20333
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU20333%27 HTTP/1.1" 200 None
2026-03-30 09:02:55 [auto1.it] INFO: Scrape type for HU20333: 2
2026-03-30 09:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb0f4ccf-e95f-5698-a7bb-086c87fe9444 with identifier: HU20333
2026-03-30 09:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb0f4ccf-e95f-5698-a7bb-086c87fe9444 with scrape type 2
2026-03-30 09:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb0f4ccf-e95f-5698-a7bb-086c87fe9444 with scrape type 2
2026-03-30 09:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cb0f4ccf-e95f-5698-a7bb-086c87fe9444, identifier: HU20333
2026-03-30 09:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d32d4a69-7c67-5fd3-8355-fb11f70889ff with identifier: ZG72619
2026-03-30 09:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d32d4a69-7c67-5fd3-8355-fb11f70889ff with identifier: ZG72619
2026-03-30 09:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d32d4a69-7c67-5fd3-8355-fb11f70889ff with identifier: ZG72619 to the API
2026-03-30 09:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:45:28Z',
 'fuel_type': 'petrol',
 'id': 'd32d4a69-7c67-5fd3-8355-fb11f70889ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG72619',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 98902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2017}
2026-03-30 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG72619%27 HTTP/1.1" 200 None
2026-03-30 09:02:56 [auto1.it] INFO: Saving data for ZG72619: {'auction_closing_time': 1774971928.0, 'created_time': 1774361052.23875, 'last_price_update_time': 1774861376.225562}
2026-03-30 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZG72619') HTTP/1.1" 204 0
2026-03-30 09:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_a6f4898fa3113d0159091700fa221834.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cb0f4ccf-e95f-5698-a7bb-086c87fe9444 with identifier: HU20333
2026-03-30 09:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cb0f4ccf-e95f-5698-a7bb-086c87fe9444 with identifier: HU20333
2026-03-30 09:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cb0f4ccf-e95f-5698-a7bb-086c87fe9444 with identifier: HU20333 to the API
2026-03-30 09:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:07:10Z',
 'fuel_type': 'diesel',
 'id': 'cb0f4ccf-e95f-5698-a7bb-086c87fe9444',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU20333',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 211216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-14',
 'seller_name': None,
 'title': 'Jeep Renegade 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2015}
2026-03-30 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU20333%27 HTTP/1.1" 200 None
2026-03-30 09:02:56 [auto1.it] INFO: Saving data for HU20333: {'auction_closing_time': 1774969630.0, 'created_time': 1773522060.851265, 'last_price_update_time': 1774861376.850301}
2026-03-30 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU20333') HTTP/1.1" 204 0
2026-03-30 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_2f91e07b08c04665352b860c079027eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_2f91e07b08c04665352b860c079027eb.jpg not downloaded yet
2026-03-30 09:02:56 [auto1.it] INFO: Found listing with ID: UX25777
2026-03-30 09:02:56 [auto1.it] INFO: Found listing with ID: JJ67638
2026-03-30 09:02:56 [auto1.it] INFO: Found listing with ID: GT84343
2026-03-30 09:02:56 [auto1.it] INFO: Found listing with ID: HH27298
2026-03-30 09:02:56 [auto1.it] INFO: Found listing with ID: GY59997
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY59997%27 HTTP/1.1" 200 None
2026-03-30 09:02:57 [auto1.it] INFO: Scrape type for GY59997: 2
2026-03-30 09:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8baffde-df6b-5bd7-a1aa-66a4e954209a with identifier: GY59997
2026-03-30 09:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8baffde-df6b-5bd7-a1aa-66a4e954209a with scrape type 2
2026-03-30 09:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8baffde-df6b-5bd7-a1aa-66a4e954209a with scrape type 2
2026-03-30 09:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8baffde-df6b-5bd7-a1aa-66a4e954209a, identifier: GY59997
2026-03-30 09:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb311afc-46b5-5598-a34e-d1a3af7ce8f7 with identifier: FJ15819
2026-03-30 09:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7 with scrape type 1
2026-03-30 09:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_4699bfad68e701e470a0cd45a4bdfde3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_4699bfad68e701e470a0cd45a4bdfde3.jpg not downloaded yet
2026-03-30 09:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_6ff56f8c31b98153e4108cc8c0ad544f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:57 [auto1.it] INFO: Found listing with ID: RA62003
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA62003%27 HTTP/1.1" 200 None
2026-03-30 09:02:57 [auto1.it] INFO: Scrape type for RA62003: 2
2026-03-30 09:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b7c79bc-4a10-5a7d-b0b6-dd06d6da1352 with identifier: RA62003
2026-03-30 09:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b7c79bc-4a10-5a7d-b0b6-dd06d6da1352 with scrape type 2
2026-03-30 09:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b7c79bc-4a10-5a7d-b0b6-dd06d6da1352 with scrape type 2
2026-03-30 09:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b7c79bc-4a10-5a7d-b0b6-dd06d6da1352, identifier: RA62003
2026-03-30 09:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8baffde-df6b-5bd7-a1aa-66a4e954209a with identifier: GY59997
2026-03-30 09:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8baffde-df6b-5bd7-a1aa-66a4e954209a with identifier: GY59997
2026-03-30 09:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8baffde-df6b-5bd7-a1aa-66a4e954209a with identifier: GY59997 to the API
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:51:31Z',
 'fuel_type': 'diesel',
 'id': 'd8baffde-df6b-5bd7-a1aa-66a4e954209a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY59997',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Freemont',
 'odometer': 227245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-21',
 'seller_name': None,
 'title': 'Fiat Freemont 2.0 Multijet Lounge 4WD',
 'transmission': 'automatic',
 'trim': 'Lounge 4WD',
 'year': 2014}
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY59997%27 HTTP/1.1" 200 None
2026-03-30 09:02:57 [auto1.it] INFO: Saving data for GY59997: {'auction_closing_time': 1774972291.0, 'created_time': 1774472816.210473, 'last_price_update_time': 1774861377.593428}
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY59997') HTTP/1.1" 204 0
2026-03-30 09:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b7c79bc-4a10-5a7d-b0b6-dd06d6da1352 with identifier: RA62003
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 09:02:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b7c79bc-4a10-5a7d-b0b6-dd06d6da1352 with identifier: RA62003
2026-03-30 09:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b7c79bc-4a10-5a7d-b0b6-dd06d6da1352 with identifier: RA62003 to the API
2026-03-30 09:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:45:15Z',
 'fuel_type': 'petrol',
 'id': '6b7c79bc-4a10-5a7d-b0b6-dd06d6da1352',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA62003',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 54865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-26',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Advanced',
 'transmission': 'manual',
 'trim': 'Advanced',
 'year': 2019}
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA62003%27 HTTP/1.1" 200 None
2026-03-30 09:02:58 [auto1.it] INFO: Saving data for RA62003: {'auction_closing_time': 1774971915.0, 'created_time': 1772705228.776166, 'last_price_update_time': 1774861378.186423}
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA62003') HTTP/1.1" 204 0
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_a1a3ae045d0e0b3e8ff64de44414e4a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_a1a3ae045d0e0b3e8ff64de44414e4a3.jpg not downloaded yet
2026-03-30 09:02:58 [auto1.it] INFO: Found listing with ID: JG07033
2026-03-30 09:02:58 [auto1.it] INFO: Found listing with ID: LR66295
2026-03-30 09:02:58 [auto1.it] INFO: Found listing with ID: PF84937
2026-03-30 09:02:58 [auto1.it] INFO: Found listing with ID: EX40669
2026-03-30 09:02:58 [auto1.it] INFO: Found listing with ID: FL66155
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL66155%27 HTTP/1.1" 200 None
2026-03-30 09:02:58 [auto1.it] INFO: Scrape type for FL66155: 2
2026-03-30 09:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa66fc35-5821-5ee5-9395-aa0cec6710b3 with identifier: FL66155
2026-03-30 09:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa66fc35-5821-5ee5-9395-aa0cec6710b3 with scrape type 2
2026-03-30 09:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa66fc35-5821-5ee5-9395-aa0cec6710b3 with scrape type 2
2026-03-30 09:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa66fc35-5821-5ee5-9395-aa0cec6710b3, identifier: FL66155
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_c0f36c8668f3a68b20743c51f8ac8236.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_c0f36c8668f3a68b20743c51f8ac8236.jpg not downloaded yet
2026-03-30 09:02:58 [auto1.it] INFO: Found listing with ID: KE18489
2026-03-30 09:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa66fc35-5821-5ee5-9395-aa0cec6710b3 with identifier: FL66155
2026-03-30 09:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa66fc35-5821-5ee5-9395-aa0cec6710b3 with identifier: FL66155
2026-03-30 09:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa66fc35-5821-5ee5-9395-aa0cec6710b3 with identifier: FL66155 to the API
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:03:17Z',
 'fuel_type': 'hybrid',
 'id': 'fa66fc35-5821-5ee5-9395-aa0cec6710b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL66155',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 165966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'Toyota Auris 1.8 Hybrid Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2015}
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL66155%27 HTTP/1.1" 200 None
2026-03-30 09:02:58 [auto1.it] INFO: Saving data for FL66155: {'auction_closing_time': 1774969397.0, 'created_time': 1773484234.104804, 'last_price_update_time': 1774861378.754756}
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FL66155') HTTP/1.1" 204 0
2026-03-30 09:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_040ef793972fdffb0bb74db6f339f924.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_64f55137b91e2b7bb43e55720b73d250.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_bdf5e57aa88a81c72f1c77a10e579a3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_bdf5e57aa88a81c72f1c77a10e579a3e.jpg not downloaded yet
2026-03-30 09:02:58 [auto1.it] INFO: Found listing with ID: PP47807
2026-03-30 09:02:58 [auto1.it] INFO: Found listing with ID: JV22884
2026-03-30 09:02:58 [auto1.it] INFO: Found listing with ID: PP82973
2026-03-30 09:02:58 [auto1.it] INFO: Found listing with ID: CU36699
2026-03-30 09:02:58 [auto1.it] INFO: Found listing with ID: ZU45449
2026-03-30 09:02:58 [auto1.it] INFO: Found listing with ID: ZV41992
2026-03-30 09:02:58 [auto1.it] INFO: Found listing with ID: PG97682
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG97682%27 HTTP/1.1" 200 None
2026-03-30 09:02:58 [auto1.it] INFO: Scrape type for PG97682: 2
2026-03-30 09:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eac4fd36-8890-5a49-a849-c388a222c148 with identifier: PG97682
2026-03-30 09:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eac4fd36-8890-5a49-a849-c388a222c148 with scrape type 2
2026-03-30 09:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eac4fd36-8890-5a49-a849-c388a222c148 with scrape type 2
2026-03-30 09:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eac4fd36-8890-5a49-a849-c388a222c148, identifier: PG97682
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_6e1f7a8545cf18e508602d1e0fcfe6c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_6e1f7a8545cf18e508602d1e0fcfe6c2.jpg not downloaded yet
2026-03-30 09:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d49010>
2026-03-30 09:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_a6f4898fa3113d0159091700fa221834.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_a6f4898fa3113d0159091700fa221834.jpg saved to cache
2026-03-30 09:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea036585-d06d-57db-92c9-a238b1e2a9ac
2026-03-30 09:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cafe50>
2026-03-30 09:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_6ff56f8c31b98153e4108cc8c0ad544f.jpg') HTTP/1.1" 204 0
2026-03-30 09:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_6ff56f8c31b98153e4108cc8c0ad544f.jpg saved to cache
2026-03-30 09:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0066079f-1ba1-5322-810b-b31ff6e67689
2026-03-30 09:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_bdfdaf831a3bf168515737b87e76fb6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eac4fd36-8890-5a49-a849-c388a222c148 with identifier: PG97682
2026-03-30 09:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eac4fd36-8890-5a49-a849-c388a222c148 with identifier: PG97682
2026-03-30 09:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eac4fd36-8890-5a49-a849-c388a222c148 with identifier: PG97682 to the API
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:21:38Z',
 'fuel_type': 'petrol',
 'id': 'eac4fd36-8890-5a49-a849-c388a222c148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG97682',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 160080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-31',
 'seller_name': None,
 'title': 'Suzuki SX4 1.0 BoosterJet AllGrip Shine 4x4',
 'transmission': 'manual',
 'trim': 'AllGrip Shine 4x4',
 'year': 2017}
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG97682%27 HTTP/1.1" 200 None
2026-03-30 09:02:59 [auto1.it] INFO: Saving data for PG97682: {'auction_closing_time': 1774970498.0, 'created_time': 1773954652.710501, 'last_price_update_time': 1774861379.702854}
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PG97682') HTTP/1.1" 204 0
2026-03-30 09:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_80b9fbde16d092e6143b047cee5e9871.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_7e2ac68db0ed1e79834d078e6000147b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_5cd1a62368f4f06cbb591f977606f3d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_5cd1a62368f4f06cbb591f977606f3d9.jpg not downloaded yet
2026-03-30 09:02:59 [auto1.it] INFO: Found listing with ID: XR25970
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR25970%27 HTTP/1.1" 200 None
2026-03-30 09:02:59 [auto1.it] INFO: Scrape type for XR25970: 1
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_4ee1a5f961c52f5ae192d08f948948fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_4ee1a5f961c52f5ae192d08f948948fa.jpg not downloaded yet
2026-03-30 09:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_b35865d427b83b4cfa8019111a962f31.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_1e03926795c0673053c1bcf1bca794b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_1e03926795c0673053c1bcf1bca794b1.jpg not downloaded yet
2026-03-30 09:02:59 [auto1.it] INFO: Found listing with ID: VF12324
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF12324%27 HTTP/1.1" 200 None
2026-03-30 09:02:59 [auto1.it] INFO: Scrape type for VF12324: 2
2026-03-30 09:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85e4d23f-0bae-535c-af0c-b138637cbf56 with identifier: VF12324
2026-03-30 09:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85e4d23f-0bae-535c-af0c-b138637cbf56 with scrape type 2
2026-03-30 09:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85e4d23f-0bae-535c-af0c-b138637cbf56 with scrape type 2
2026-03-30 09:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 85e4d23f-0bae-535c-af0c-b138637cbf56, identifier: VF12324
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_650c3c844cd3e2d42ad826357bec2c2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_650c3c844cd3e2d42ad826357bec2c2c.jpg not downloaded yet
2026-03-30 09:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 85e4d23f-0bae-535c-af0c-b138637cbf56 with identifier: VF12324
2026-03-30 09:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 85e4d23f-0bae-535c-af0c-b138637cbf56 with identifier: VF12324
2026-03-30 09:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 85e4d23f-0bae-535c-af0c-b138637cbf56 with identifier: VF12324 to the API
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:25:06Z',
 'fuel_type': 'diesel',
 'id': '85e4d23f-0bae-535c-af0c-b138637cbf56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF12324',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 106518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-13',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF12324%27 HTTP/1.1" 200 None
2026-03-30 09:03:00 [auto1.it] INFO: Saving data for VF12324: {'auction_closing_time': 1774970706.0, 'created_time': 1774440059.768648, 'last_price_update_time': 1774861380.449842}
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VF12324') HTTP/1.1" 204 0
2026-03-30 09:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0619f6d0>
2026-03-30 09:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_040ef793972fdffb0bb74db6f339f924.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_040ef793972fdffb0bb74db6f339f924.jpg saved to cache
2026-03-30 09:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0066079f-1ba1-5322-810b-b31ff6e67689
2026-03-30 09:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ed6dd0>
2026-03-30 09:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_64f55137b91e2b7bb43e55720b73d250.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_64f55137b91e2b7bb43e55720b73d250.jpg saved to cache
2026-03-30 09:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b767cebb-7d47-58e7-bed7-591a8c61d7d3
2026-03-30 09:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062fb750>
2026-03-30 09:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_bdfdaf831a3bf168515737b87e76fb6a.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_bdfdaf831a3bf168515737b87e76fb6a.jpg saved to cache
2026-03-30 09:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0066079f-1ba1-5322-810b-b31ff6e67689
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_8daae6e54c4938bc7ae4a0e03d62a20d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_8daae6e54c4938bc7ae4a0e03d62a20d.jpg not downloaded yet
2026-03-30 09:03:00 [auto1.it] INFO: Found listing with ID: VG29105
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG29105%27 HTTP/1.1" 200 None
2026-03-30 09:03:00 [auto1.it] INFO: Scrape type for VG29105: 2
2026-03-30 09:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af8410e9-17f7-5a87-b313-e3db9b00e712 with identifier: VG29105
2026-03-30 09:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af8410e9-17f7-5a87-b313-e3db9b00e712 with scrape type 2
2026-03-30 09:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af8410e9-17f7-5a87-b313-e3db9b00e712 with scrape type 2
2026-03-30 09:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af8410e9-17f7-5a87-b313-e3db9b00e712, identifier: VG29105
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_3f0ffbaff18d6b911dcc9e2dae8cf486.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_3f0ffbaff18d6b911dcc9e2dae8cf486.jpg not downloaded yet
2026-03-30 09:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_bb616d0ab612cc63d29eda36fa6c3751.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_5c3c54c24d86bdb912fcbba2e069f238.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af8410e9-17f7-5a87-b313-e3db9b00e712 with identifier: VG29105
2026-03-30 09:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af8410e9-17f7-5a87-b313-e3db9b00e712 with identifier: VG29105
2026-03-30 09:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af8410e9-17f7-5a87-b313-e3db9b00e712 with identifier: VG29105 to the API
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:03:29Z',
 'fuel_type': 'petrol',
 'id': 'af8410e9-17f7-5a87-b313-e3db9b00e712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG29105',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 99367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seller_name': None,
 'title': 'Mazda 2 1.5 Skyactiv-G Mild-Hybrid Evolve',
 'transmission': 'manual',
 'trim': 'Evolve',
 'year': 2020}
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG29105%27 HTTP/1.1" 200 None
2026-03-30 09:03:01 [auto1.it] INFO: Saving data for VG29105: {'auction_closing_time': 1774969409.0, 'created_time': 1773997297.911127, 'last_price_update_time': 1774861381.542051}
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VG29105') HTTP/1.1" 204 0
2026-03-30 09:03:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e34dd0>
2026-03-30 09:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_80b9fbde16d092e6143b047cee5e9871.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_80b9fbde16d092e6143b047cee5e9871.jpg saved to cache
2026-03-30 09:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0066079f-1ba1-5322-810b-b31ff6e67689
2026-03-30 09:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063fa090>
2026-03-30 09:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_7e2ac68db0ed1e79834d078e6000147b.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_7e2ac68db0ed1e79834d078e6000147b.jpg saved to cache
2026-03-30 09:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b767cebb-7d47-58e7-bed7-591a8c61d7d3
2026-03-30 09:03:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c1be10>
2026-03-30 09:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_b35865d427b83b4cfa8019111a962f31.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_b35865d427b83b4cfa8019111a962f31.jpg saved to cache
2026-03-30 09:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0066079f-1ba1-5322-810b-b31ff6e67689
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_7fbd9a531bcfa60e29cadfb522ca24ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_7fbd9a531bcfa60e29cadfb522ca24ef.jpg not downloaded yet
2026-03-30 09:03:01 [auto1.it] INFO: Found listing with ID: EU76954
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU76954%27 HTTP/1.1" 200 None
2026-03-30 09:03:01 [auto1.it] INFO: Scrape type for EU76954: 2
2026-03-30 09:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c647714-19f9-5334-94b1-01fe441b09e7 with identifier: EU76954
2026-03-30 09:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c647714-19f9-5334-94b1-01fe441b09e7 with scrape type 2
2026-03-30 09:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c647714-19f9-5334-94b1-01fe441b09e7 with scrape type 2
2026-03-30 09:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c647714-19f9-5334-94b1-01fe441b09e7, identifier: EU76954
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_c31018876a093431e9be9bbe371c6a74.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_c31018876a093431e9be9bbe371c6a74.jpg not downloaded yet
2026-03-30 09:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c647714-19f9-5334-94b1-01fe441b09e7 with identifier: EU76954
2026-03-30 09:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c647714-19f9-5334-94b1-01fe441b09e7 with identifier: EU76954
2026-03-30 09:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c647714-19f9-5334-94b1-01fe441b09e7 with identifier: EU76954 to the API
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:43:45Z',
 'fuel_type': 'petrol',
 'id': '4c647714-19f9-5334-94b1-01fe441b09e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU76954',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 316247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-07',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TGI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU76954%27 HTTP/1.1" 200 None
2026-03-30 09:03:02 [auto1.it] INFO: Saving data for EU76954: {'auction_closing_time': 1774971825.0, 'created_time': 1773674202.897125, 'last_price_update_time': 1774861382.416998}
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU76954') HTTP/1.1" 204 0
2026-03-30 09:03:02 [auto1.it] INFO: Found listing with ID: HE03479
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE03479%27 HTTP/1.1" 200 None
2026-03-30 09:03:02 [auto1.it] INFO: Scrape type for HE03479: 2
2026-03-30 09:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e282430-e985-547e-885c-4e3f79dd5094 with identifier: HE03479
2026-03-30 09:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e282430-e985-547e-885c-4e3f79dd5094 with scrape type 2
2026-03-30 09:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e282430-e985-547e-885c-4e3f79dd5094 with scrape type 2
2026-03-30 09:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e282430-e985-547e-885c-4e3f79dd5094, identifier: HE03479
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_c3463ab95aed3b3b66d8b2d6473e536a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_c3463ab95aed3b3b66d8b2d6473e536a.jpg not downloaded yet
2026-03-30 09:03:02 [auto1.it] INFO: Channel: 24h | Page: 13 | totalHits: 3293 | hits on page: 40
2026-03-30 09:03:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06199010>
2026-03-30 09:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_bb616d0ab612cc63d29eda36fa6c3751.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_bb616d0ab612cc63d29eda36fa6c3751.jpg saved to cache
2026-03-30 09:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b767cebb-7d47-58e7-bed7-591a8c61d7d3
2026-03-30 09:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e456d0>
2026-03-30 09:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_5c3c54c24d86bdb912fcbba2e069f238.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_5c3c54c24d86bdb912fcbba2e069f238.jpg saved to cache
2026-03-30 09:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f
2026-03-30 09:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_06157016f748e0558fc07691fd2cc602.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e282430-e985-547e-885c-4e3f79dd5094 with identifier: HE03479
2026-03-30 09:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e282430-e985-547e-885c-4e3f79dd5094 with identifier: HE03479
2026-03-30 09:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6e282430-e985-547e-885c-4e3f79dd5094 with identifier: HE03479 to the API
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:11:18Z',
 'fuel_type': 'petrol',
 'id': '6e282430-e985-547e-885c-4e3f79dd5094',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE03479',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 202484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2010}
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE03479%27 HTTP/1.1" 200 None
2026-03-30 09:03:03 [auto1.it] INFO: Saving data for HE03479: {'auction_closing_time': 1774969878.0, 'created_time': 1774386040.852031, 'last_price_update_time': 1774861383.087842}
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HE03479') HTTP/1.1" 204 0
2026-03-30 09:03:03 [auto1.it] INFO: Found listing with ID: WN10249
2026-03-30 09:03:03 [auto1.it] INFO: Found listing with ID: VC96315
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC96315%27 HTTP/1.1" 200 None
2026-03-30 09:03:03 [auto1.it] INFO: Scrape type for VC96315: 2
2026-03-30 09:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 898234e2-1ec2-5ebb-9f91-668b83e2f8d6 with identifier: VC96315
2026-03-30 09:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 898234e2-1ec2-5ebb-9f91-668b83e2f8d6 with scrape type 2
2026-03-30 09:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 898234e2-1ec2-5ebb-9f91-668b83e2f8d6 with scrape type 2
2026-03-30 09:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 898234e2-1ec2-5ebb-9f91-668b83e2f8d6, identifier: VC96315
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_7b1cc37cd07edc68be7891328bfdacb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_7b1cc37cd07edc68be7891328bfdacb5.jpg not downloaded yet
2026-03-30 09:03:03 [auto1.it] INFO: Found listing with ID: XU27614
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU27614%27 HTTP/1.1" 200 None
2026-03-30 09:03:03 [auto1.it] INFO: Scrape type for XU27614: 2
2026-03-30 09:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0991af75-699f-5cc4-aca9-f8a8a53c64b8 with identifier: XU27614
2026-03-30 09:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0991af75-699f-5cc4-aca9-f8a8a53c64b8 with scrape type 2
2026-03-30 09:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0991af75-699f-5cc4-aca9-f8a8a53c64b8 with scrape type 2
2026-03-30 09:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0991af75-699f-5cc4-aca9-f8a8a53c64b8, identifier: XU27614
2026-03-30 09:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 898234e2-1ec2-5ebb-9f91-668b83e2f8d6 with identifier: VC96315
2026-03-30 09:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 898234e2-1ec2-5ebb-9f91-668b83e2f8d6 with identifier: VC96315
2026-03-30 09:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 898234e2-1ec2-5ebb-9f91-668b83e2f8d6 with identifier: VC96315 to the API
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:11:49Z',
 'fuel_type': 'diesel',
 'id': '898234e2-1ec2-5ebb-9f91-668b83e2f8d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC96315',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 175187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-18',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2014}
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC96315%27 HTTP/1.1" 200 None
2026-03-30 09:03:03 [auto1.it] INFO: Saving data for VC96315: {'auction_closing_time': 1774969909.0, 'created_time': 1773954054.696619, 'last_price_update_time': 1774861383.72043}
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VC96315') HTTP/1.1" 204 0
2026-03-30 09:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0991af75-699f-5cc4-aca9-f8a8a53c64b8 with identifier: XU27614
2026-03-30 09:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0991af75-699f-5cc4-aca9-f8a8a53c64b8 with identifier: XU27614
2026-03-30 09:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0991af75-699f-5cc4-aca9-f8a8a53c64b8 with identifier: XU27614 to the API
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:41:27Z',
 'fuel_type': 'diesel',
 'id': '0991af75-699f-5cc4-aca9-f8a8a53c64b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU27614',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 168144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-19',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Comfort ISG 2WD',
 'transmission': 'manual',
 'trim': 'Comfort ISG 2WD',
 'year': 2017}
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU27614%27 HTTP/1.1" 200 None
2026-03-30 09:03:04 [auto1.it] INFO: Saving data for XU27614: {'auction_closing_time': 1774971687.0, 'created_time': 1773484944.641753, 'last_price_update_time': 1774861384.077933}
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XU27614') HTTP/1.1" 204 0
2026-03-30 09:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_7fbd9a531bcfa60e29cadfb522ca24ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_c31018876a093431e9be9bbe371c6a74.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:04 [scrapy.extensions.logstats] INFO: Crawled 139 pages (at 22 pages/min), scraped 192 items (at 87 items/min)
2026-03-30 09:03:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 197MiB
2026-03-30 09:03:04 [auto1.it] INFO: Found listing with ID: DG11990
2026-03-30 09:03:04 [auto1.it] INFO: Found listing with ID: VW71649
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW71649%27 HTTP/1.1" 200 None
2026-03-30 09:03:04 [auto1.it] INFO: Scrape type for VW71649: 2
2026-03-30 09:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa7ada56-7387-5e7c-83b9-cee7f9a03b2f with identifier: VW71649
2026-03-30 09:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa7ada56-7387-5e7c-83b9-cee7f9a03b2f with scrape type 2
2026-03-30 09:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa7ada56-7387-5e7c-83b9-cee7f9a03b2f with scrape type 2
2026-03-30 09:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa7ada56-7387-5e7c-83b9-cee7f9a03b2f, identifier: VW71649
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_4fbcfc19879e8eed670347a71d52a1c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_4fbcfc19879e8eed670347a71d52a1c3.jpg not downloaded yet
2026-03-30 09:03:04 [auto1.it] INFO: Found listing with ID: TN93394
2026-03-30 09:03:04 [auto1.it] INFO: Found listing with ID: KT64374
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64374%27 HTTP/1.1" 200 None
2026-03-30 09:03:04 [auto1.it] INFO: Scrape type for KT64374: 2
2026-03-30 09:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f527b6df-fbcf-5815-a52f-0a5af05cc9d5 with identifier: KT64374
2026-03-30 09:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f527b6df-fbcf-5815-a52f-0a5af05cc9d5 with scrape type 2
2026-03-30 09:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f527b6df-fbcf-5815-a52f-0a5af05cc9d5 with scrape type 2
2026-03-30 09:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f527b6df-fbcf-5815-a52f-0a5af05cc9d5, identifier: KT64374
2026-03-30 09:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_2748437cbab8017d63c37f882c3c1a4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_3f0ffbaff18d6b911dcc9e2dae8cf486.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa7ada56-7387-5e7c-83b9-cee7f9a03b2f with identifier: VW71649
2026-03-30 09:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa7ada56-7387-5e7c-83b9-cee7f9a03b2f with identifier: VW71649
2026-03-30 09:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa7ada56-7387-5e7c-83b9-cee7f9a03b2f with identifier: VW71649 to the API
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:35:22Z',
 'fuel_type': 'diesel',
 'id': 'fa7ada56-7387-5e7c-83b9-cee7f9a03b2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW71649',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 243665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-06',
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW71649%27 HTTP/1.1" 200 None
2026-03-30 09:03:04 [auto1.it] INFO: Saving data for VW71649: {'auction_closing_time': 1774971322.0, 'created_time': 1773484047.512399, 'last_price_update_time': 1774861384.715516}
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VW71649') HTTP/1.1" 204 0
2026-03-30 09:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f527b6df-fbcf-5815-a52f-0a5af05cc9d5 with identifier: KT64374
2026-03-30 09:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f527b6df-fbcf-5815-a52f-0a5af05cc9d5 with identifier: KT64374
2026-03-30 09:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f527b6df-fbcf-5815-a52f-0a5af05cc9d5 with identifier: KT64374 to the API
2026-03-30 09:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:36:03Z',
 'fuel_type': 'petrol',
 'id': 'f527b6df-fbcf-5815-a52f-0a5af05cc9d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT64374',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 19307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-29',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Mild-Hybrid Techno',
 'transmission': 'manual',
 'trim': 'Techno',
 'year': 2023}
2026-03-30 09:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64374%27 HTTP/1.1" 200 None
2026-03-30 09:03:05 [auto1.it] INFO: Saving data for KT64374: {'auction_closing_time': 1774971363.0, 'created_time': 1773130363.611067, 'last_price_update_time': 1774861385.44037}
2026-03-30 09:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT64374') HTTP/1.1" 204 0
2026-03-30 09:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e81990>
2026-03-30 09:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_06157016f748e0558fc07691fd2cc602.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_06157016f748e0558fc07691fd2cc602.jpg saved to cache
2026-03-30 09:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0066079f-1ba1-5322-810b-b31ff6e67689
2026-03-30 09:03:05 [auto1.it] INFO: Found listing with ID: FC87594
2026-03-30 09:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC87594%27 HTTP/1.1" 200 None
2026-03-30 09:03:05 [auto1.it] INFO: Scrape type for FC87594: 2
2026-03-30 09:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ac13a24-fd7a-5492-9840-663b98374b53 with identifier: FC87594
2026-03-30 09:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ac13a24-fd7a-5492-9840-663b98374b53 with scrape type 2
2026-03-30 09:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ac13a24-fd7a-5492-9840-663b98374b53 with scrape type 2
2026-03-30 09:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2ac13a24-fd7a-5492-9840-663b98374b53, identifier: FC87594
2026-03-30 09:03:05 [auto1.it] INFO: Found listing with ID: SN21626
2026-03-30 09:03:05 [auto1.it] INFO: Found listing with ID: SJ75121
2026-03-30 09:03:05 [auto1.it] INFO: Found listing with ID: PP13796
2026-03-30 09:03:05 [auto1.it] INFO: Found listing with ID: YM04442
2026-03-30 09:03:05 [auto1.it] INFO: Found listing with ID: DW64097
2026-03-30 09:03:05 [auto1.it] INFO: Found listing with ID: TU77617
2026-03-30 09:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU77617%27 HTTP/1.1" 200 None
2026-03-30 09:03:05 [auto1.it] INFO: Scrape type for TU77617: 2
2026-03-30 09:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5339a21-6f61-5469-bc01-daf5951fdf23 with identifier: TU77617
2026-03-30 09:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5339a21-6f61-5469-bc01-daf5951fdf23 with scrape type 2
2026-03-30 09:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5339a21-6f61-5469-bc01-daf5951fdf23 with scrape type 2
2026-03-30 09:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b5339a21-6f61-5469-bc01-daf5951fdf23, identifier: TU77617
2026-03-30 09:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2ac13a24-fd7a-5492-9840-663b98374b53 with identifier: FC87594
2026-03-30 09:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2ac13a24-fd7a-5492-9840-663b98374b53 with identifier: FC87594
2026-03-30 09:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2ac13a24-fd7a-5492-9840-663b98374b53 with identifier: FC87594 to the API
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:26:50Z',
 'fuel_type': 'petrol',
 'id': '2ac13a24-fd7a-5492-9840-663b98374b53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC87594',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 169150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC87594%27 HTTP/1.1" 200 None
2026-03-30 09:03:06 [auto1.it] INFO: Saving data for FC87594: {'auction_closing_time': 1774970810.0, 'created_time': 1774353897.286091, 'last_price_update_time': 1774861386.238521}
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FC87594') HTTP/1.1" 204 0
2026-03-30 09:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b5339a21-6f61-5469-bc01-daf5951fdf23 with identifier: TU77617
2026-03-30 09:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b5339a21-6f61-5469-bc01-daf5951fdf23 with identifier: TU77617
2026-03-30 09:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b5339a21-6f61-5469-bc01-daf5951fdf23 with identifier: TU77617 to the API
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:51:46Z',
 'fuel_type': 'diesel',
 'id': 'b5339a21-6f61-5469-bc01-daf5951fdf23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU77617',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 165807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-31',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU77617%27 HTTP/1.1" 200 None
2026-03-30 09:03:06 [auto1.it] INFO: Saving data for TU77617: {'auction_closing_time': 1774972306.0, 'created_time': 1773489629.294098, 'last_price_update_time': 1774861386.673301}
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TU77617') HTTP/1.1" 204 0
2026-03-30 09:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06da1350>
2026-03-30 09:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_7fbd9a531bcfa60e29cadfb522ca24ef.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_7fbd9a531bcfa60e29cadfb522ca24ef.jpg saved to cache
2026-03-30 09:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f
2026-03-30 09:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fc7750>
2026-03-30 09:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_c31018876a093431e9be9bbe371c6a74.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_c31018876a093431e9be9bbe371c6a74.jpg saved to cache
2026-03-30 09:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7
2026-03-30 09:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_4ee1a5f961c52f5ae192d08f948948fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_650c3c844cd3e2d42ad826357bec2c2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_8daae6e54c4938bc7ae4a0e03d62a20d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:06 [auto1.it] INFO: Found listing with ID: AD85464
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD85464%27 HTTP/1.1" 200 None
2026-03-30 09:03:06 [auto1.it] INFO: Scrape type for AD85464: 2
2026-03-30 09:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36ed1ed4-f64c-51e3-8363-8222936bd433 with identifier: AD85464
2026-03-30 09:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36ed1ed4-f64c-51e3-8363-8222936bd433 with scrape type 2
2026-03-30 09:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36ed1ed4-f64c-51e3-8363-8222936bd433 with scrape type 2
2026-03-30 09:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36ed1ed4-f64c-51e3-8363-8222936bd433, identifier: AD85464
2026-03-30 09:03:06 [auto1.it] INFO: Found listing with ID: AN44803
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN44803%27 HTTP/1.1" 200 None
2026-03-30 09:03:06 [auto1.it] INFO: Scrape type for AN44803: 2
2026-03-30 09:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 940c49f9-9cf3-565e-b915-d9d2403e8b4e with identifier: AN44803
2026-03-30 09:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 940c49f9-9cf3-565e-b915-d9d2403e8b4e with scrape type 2
2026-03-30 09:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 940c49f9-9cf3-565e-b915-d9d2403e8b4e with scrape type 2
2026-03-30 09:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 940c49f9-9cf3-565e-b915-d9d2403e8b4e, identifier: AN44803
2026-03-30 09:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_1e03926795c0673053c1bcf1bca794b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36ed1ed4-f64c-51e3-8363-8222936bd433 with identifier: AD85464
2026-03-30 09:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36ed1ed4-f64c-51e3-8363-8222936bd433 with identifier: AD85464
2026-03-30 09:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 36ed1ed4-f64c-51e3-8363-8222936bd433 with identifier: AD85464 to the API
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:40:56Z',
 'fuel_type': 'diesel',
 'id': '36ed1ed4-f64c-51e3-8363-8222936bd433',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD85464',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 191776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-28',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Kinetic 2WD',
 'transmission': 'manual',
 'trim': 'Kinetic 2WD',
 'year': 2013}
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD85464%27 HTTP/1.1" 200 None
2026-03-30 09:03:07 [auto1.it] INFO: Saving data for AD85464: {'auction_closing_time': 1774971656.0, 'created_time': 1773327720.028238, 'last_price_update_time': 1774861387.422154}
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AD85464') HTTP/1.1" 204 0
2026-03-30 09:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 940c49f9-9cf3-565e-b915-d9d2403e8b4e with identifier: AN44803
2026-03-30 09:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 940c49f9-9cf3-565e-b915-d9d2403e8b4e with identifier: AN44803
2026-03-30 09:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 940c49f9-9cf3-565e-b915-d9d2403e8b4e with identifier: AN44803 to the API
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:50:22Z',
 'fuel_type': 'diesel',
 'id': '940c49f9-9cf3-565e-b915-d9d2403e8b4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN44803',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 147520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-22',
 'seller_name': None,
 'title': 'BMW X1 sDrive 16d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2021}
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN44803%27 HTTP/1.1" 200 None
2026-03-30 09:03:07 [auto1.it] INFO: Saving data for AN44803: {'auction_closing_time': 1774972222.0, 'created_time': 1774353856.760937, 'last_price_update_time': 1774861387.784649}
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AN44803') HTTP/1.1" 204 0
2026-03-30 09:03:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0610ae90>
2026-03-30 09:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_2748437cbab8017d63c37f882c3c1a4c.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_2748437cbab8017d63c37f882c3c1a4c.jpg saved to cache
2026-03-30 09:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea036585-d06d-57db-92c9-a238b1e2a9ac
2026-03-30 09:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e233d0>
2026-03-30 09:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_3f0ffbaff18d6b911dcc9e2dae8cf486.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_3f0ffbaff18d6b911dcc9e2dae8cf486.jpg saved to cache
2026-03-30 09:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7
2026-03-30 09:03:07 [auto1.it] INFO: Found listing with ID: SP63067
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP63067%27 HTTP/1.1" 200 None
2026-03-30 09:03:07 [auto1.it] INFO: Scrape type for SP63067: 2
2026-03-30 09:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca88420f-8e8d-53d8-aea4-b383a71de4c5 with identifier: SP63067
2026-03-30 09:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca88420f-8e8d-53d8-aea4-b383a71de4c5 with scrape type 2
2026-03-30 09:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca88420f-8e8d-53d8-aea4-b383a71de4c5 with scrape type 2
2026-03-30 09:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ca88420f-8e8d-53d8-aea4-b383a71de4c5, identifier: SP63067
2026-03-30 09:03:08 [auto1.it] INFO: Found listing with ID: BG87604
2026-03-30 09:03:08 [auto1.it] INFO: Found listing with ID: KP13165
2026-03-30 09:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP13165%27 HTTP/1.1" 200 None
2026-03-30 09:03:08 [auto1.it] INFO: Scrape type for KP13165: 2
2026-03-30 09:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8293e82a-b110-5072-866b-9299417ae6d0 with identifier: KP13165
2026-03-30 09:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8293e82a-b110-5072-866b-9299417ae6d0 with scrape type 2
2026-03-30 09:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8293e82a-b110-5072-866b-9299417ae6d0 with scrape type 2
2026-03-30 09:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8293e82a-b110-5072-866b-9299417ae6d0, identifier: KP13165
2026-03-30 09:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_bdf5e57aa88a81c72f1c77a10e579a3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_5cd1a62368f4f06cbb591f977606f3d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ca88420f-8e8d-53d8-aea4-b383a71de4c5 with identifier: SP63067
2026-03-30 09:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ca88420f-8e8d-53d8-aea4-b383a71de4c5 with identifier: SP63067
2026-03-30 09:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ca88420f-8e8d-53d8-aea4-b383a71de4c5 with identifier: SP63067 to the API
2026-03-30 09:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:01:41Z',
 'fuel_type': 'petrol',
 'id': 'ca88420f-8e8d-53d8-aea4-b383a71de4c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP63067',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 20611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-26',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 T-GDI N Line 2WD',
 'transmission': 'automatic',
 'trim': 'N Line 2WD',
 'year': 2024}
2026-03-30 09:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP63067%27 HTTP/1.1" 200 None
2026-03-30 09:03:08 [auto1.it] INFO: Saving data for SP63067: {'auction_closing_time': 1774969301.0, 'created_time': 1774429228.691861, 'last_price_update_time': 1774861388.563585}
2026-03-30 09:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SP63067') HTTP/1.1" 204 0
2026-03-30 09:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8293e82a-b110-5072-866b-9299417ae6d0 with identifier: KP13165
2026-03-30 09:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8293e82a-b110-5072-866b-9299417ae6d0 with identifier: KP13165
2026-03-30 09:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8293e82a-b110-5072-866b-9299417ae6d0 with identifier: KP13165 to the API
2026-03-30 09:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:20:42Z',
 'fuel_type': 'petrol',
 'id': '8293e82a-b110-5072-866b-9299417ae6d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP13165',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 198110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Unyca',
 'transmission': 'manual',
 'trim': 'Unyca',
 'year': 2012}
2026-03-30 09:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP13165%27 HTTP/1.1" 200 None
2026-03-30 09:03:08 [auto1.it] INFO: Saving data for KP13165: {'auction_closing_time': 1774970442.0, 'created_time': 1774342994.790929, 'last_price_update_time': 1774861388.989359}
2026-03-30 09:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KP13165') HTTP/1.1" 204 0
2026-03-30 09:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_6e1f7a8545cf18e508602d1e0fcfe6c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:09 [auto1.it] INFO: Found listing with ID: YW84907
2026-03-30 09:03:09 [auto1.it] INFO: Found listing with ID: JH15669
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH15669%27 HTTP/1.1" 200 None
2026-03-30 09:03:09 [auto1.it] INFO: Scrape type for JH15669: 1
2026-03-30 09:03:09 [auto1.it] INFO: Found listing with ID: SZ37038
2026-03-30 09:03:09 [auto1.it] INFO: Found listing with ID: ZZ51867
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ51867%27 HTTP/1.1" 200 None
2026-03-30 09:03:09 [auto1.it] INFO: Scrape type for ZZ51867: 2
2026-03-30 09:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4d0d004-7334-5d77-a623-02b132337897 with identifier: ZZ51867
2026-03-30 09:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d0d004-7334-5d77-a623-02b132337897 with scrape type 2
2026-03-30 09:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4d0d004-7334-5d77-a623-02b132337897 with scrape type 2
2026-03-30 09:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e4d0d004-7334-5d77-a623-02b132337897, identifier: ZZ51867
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e89950>
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_4ee1a5f961c52f5ae192d08f948948fa.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_4ee1a5f961c52f5ae192d08f948948fa.jpg saved to cache
2026-03-30 09:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062746d0>
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_650c3c844cd3e2d42ad826357bec2c2c.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_650c3c844cd3e2d42ad826357bec2c2c.jpg saved to cache
2026-03-30 09:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ed4cd0>
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_8daae6e54c4938bc7ae4a0e03d62a20d.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_8daae6e54c4938bc7ae4a0e03d62a20d.jpg saved to cache
2026-03-30 09:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06efb150>
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_1e03926795c0673053c1bcf1bca794b1.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_1e03926795c0673053c1bcf1bca794b1.jpg saved to cache
2026-03-30 09:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f
2026-03-30 09:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_7b1cc37cd07edc68be7891328bfdacb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e4d0d004-7334-5d77-a623-02b132337897 with identifier: ZZ51867
2026-03-30 09:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e4d0d004-7334-5d77-a623-02b132337897 with identifier: ZZ51867
2026-03-30 09:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e4d0d004-7334-5d77-a623-02b132337897 with identifier: ZZ51867 to the API
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:59:25Z',
 'fuel_type': 'petrol',
 'id': 'e4d0d004-7334-5d77-a623-02b132337897',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ51867',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 114803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ51867%27 HTTP/1.1" 200 None
2026-03-30 09:03:09 [auto1.it] INFO: Saving data for ZZ51867: {'auction_closing_time': 1774972765.0, 'created_time': 1773327727.995164, 'last_price_update_time': 1774861389.6584}
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ51867') HTTP/1.1" 204 0
2026-03-30 09:03:09 [auto1.it] INFO: Found listing with ID: YZ52135
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ52135%27 HTTP/1.1" 200 None
2026-03-30 09:03:09 [auto1.it] INFO: Scrape type for YZ52135: 2
2026-03-30 09:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 349401a5-2604-51cc-ac4d-bf2e72789ad2 with identifier: YZ52135
2026-03-30 09:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 349401a5-2604-51cc-ac4d-bf2e72789ad2 with scrape type 2
2026-03-30 09:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 349401a5-2604-51cc-ac4d-bf2e72789ad2 with scrape type 2
2026-03-30 09:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 349401a5-2604-51cc-ac4d-bf2e72789ad2, identifier: YZ52135
2026-03-30 09:03:09 [auto1.it] INFO: Found listing with ID: WV29949
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV29949%27 HTTP/1.1" 200 None
2026-03-30 09:03:09 [auto1.it] INFO: Scrape type for WV29949: 2
2026-03-30 09:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a5b2bfb-1539-5c1a-a22a-2b0df5d025cb with identifier: WV29949
2026-03-30 09:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a5b2bfb-1539-5c1a-a22a-2b0df5d025cb with scrape type 2
2026-03-30 09:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a5b2bfb-1539-5c1a-a22a-2b0df5d025cb with scrape type 2
2026-03-30 09:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9a5b2bfb-1539-5c1a-a22a-2b0df5d025cb, identifier: WV29949
2026-03-30 09:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0619f150>
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_bdf5e57aa88a81c72f1c77a10e579a3e.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_bdf5e57aa88a81c72f1c77a10e579a3e.jpg saved to cache
2026-03-30 09:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f
2026-03-30 09:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d38850>
2026-03-30 09:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_5cd1a62368f4f06cbb591f977606f3d9.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_5cd1a62368f4f06cbb591f977606f3d9.jpg saved to cache
2026-03-30 09:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f
2026-03-30 09:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 349401a5-2604-51cc-ac4d-bf2e72789ad2 with identifier: YZ52135
2026-03-30 09:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 349401a5-2604-51cc-ac4d-bf2e72789ad2 with identifier: YZ52135
2026-03-30 09:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 349401a5-2604-51cc-ac4d-bf2e72789ad2 with identifier: YZ52135 to the API
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:42:49Z',
 'fuel_type': 'diesel',
 'id': '349401a5-2604-51cc-ac4d-bf2e72789ad2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ52135',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 109173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-04',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Business AWD',
 'transmission': 'automatic',
 'trim': 'Business AWD',
 'year': 2018}
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ52135%27 HTTP/1.1" 200 None
2026-03-30 09:03:10 [auto1.it] INFO: Saving data for YZ52135: {'auction_closing_time': 1774971769.0, 'created_time': 1774353883.991699, 'last_price_update_time': 1774861390.413624}
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YZ52135') HTTP/1.1" 204 0
2026-03-30 09:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9a5b2bfb-1539-5c1a-a22a-2b0df5d025cb with identifier: WV29949
2026-03-30 09:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9a5b2bfb-1539-5c1a-a22a-2b0df5d025cb with identifier: WV29949
2026-03-30 09:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9a5b2bfb-1539-5c1a-a22a-2b0df5d025cb with identifier: WV29949 to the API
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:18:51Z',
 'fuel_type': 'diesel',
 'id': '9a5b2bfb-1539-5c1a-a22a-2b0df5d025cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV29949',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 153783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-11',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2011}
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV29949%27 HTTP/1.1" 200 None
2026-03-30 09:03:10 [auto1.it] INFO: Saving data for WV29949: {'auction_closing_time': 1774970331.0, 'created_time': 1773130083.839729, 'last_price_update_time': 1774861390.810153}
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WV29949') HTTP/1.1" 204 0
2026-03-30 09:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_c0f36c8668f3a68b20743c51f8ac8236.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_c3463ab95aed3b3b66d8b2d6473e536a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_4fbcfc19879e8eed670347a71d52a1c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:10 [auto1.it] INFO: Found listing with ID: ZM37074
2026-03-30 09:03:10 [auto1.it] INFO: Found listing with ID: RT96174
2026-03-30 09:03:10 [auto1.it] INFO: Found listing with ID: XU27614
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU27614%27 HTTP/1.1" 200 None
2026-03-30 09:03:10 [auto1.it] INFO: Scrape type for XU27614: 0
2026-03-30 09:03:10 [auto1.it] INFO: Found listing with ID: DA44533
2026-03-30 09:03:10 [auto1.it] INFO: Found listing with ID: DX20771
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX20771%27 HTTP/1.1" 200 None
2026-03-30 09:03:10 [auto1.it] INFO: Scrape type for DX20771: 2
2026-03-30 09:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4ab5a61-13ef-5558-8b9a-54086f92442d with identifier: DX20771
2026-03-30 09:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4ab5a61-13ef-5558-8b9a-54086f92442d with scrape type 2
2026-03-30 09:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4ab5a61-13ef-5558-8b9a-54086f92442d with scrape type 2
2026-03-30 09:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4ab5a61-13ef-5558-8b9a-54086f92442d, identifier: DX20771
2026-03-30 09:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4ab5a61-13ef-5558-8b9a-54086f92442d with identifier: DX20771
2026-03-30 09:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4ab5a61-13ef-5558-8b9a-54086f92442d with identifier: DX20771
2026-03-30 09:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4ab5a61-13ef-5558-8b9a-54086f92442d with identifier: DX20771 to the API
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:31:09Z',
 'fuel_type': 'diesel',
 'id': 'a4ab5a61-13ef-5558-8b9a-54086f92442d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX20771',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 179385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-28',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exceed 4WD',
 'transmission': 'automatic',
 'trim': 'Exceed 4WD',
 'year': 2014}
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX20771%27 HTTP/1.1" 200 None
2026-03-30 09:03:11 [auto1.it] INFO: Saving data for DX20771: {'auction_closing_time': 1774971069.0, 'created_time': 1773134844.959569, 'last_price_update_time': 1774861391.433702}
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DX20771') HTTP/1.1" 204 0
2026-03-30 09:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062bfdd0>
2026-03-30 09:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_6e1f7a8545cf18e508602d1e0fcfe6c2.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_6e1f7a8545cf18e508602d1e0fcfe6c2.jpg saved to cache
2026-03-30 09:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7
2026-03-30 09:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d82310>
2026-03-30 09:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_7b1cc37cd07edc68be7891328bfdacb5.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_7b1cc37cd07edc68be7891328bfdacb5.jpg saved to cache
2026-03-30 09:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7
2026-03-30 09:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:11 [auto1.it] INFO: Found listing with ID: EE84208
2026-03-30 09:03:11 [auto1.it] INFO: Found listing with ID: TU90316
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU90316%27 HTTP/1.1" 200 None
2026-03-30 09:03:11 [auto1.it] INFO: Scrape type for TU90316: 2
2026-03-30 09:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47c26806-e8f8-50aa-80bd-9d78435787a7 with identifier: TU90316
2026-03-30 09:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47c26806-e8f8-50aa-80bd-9d78435787a7 with scrape type 2
2026-03-30 09:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47c26806-e8f8-50aa-80bd-9d78435787a7 with scrape type 2
2026-03-30 09:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47c26806-e8f8-50aa-80bd-9d78435787a7, identifier: TU90316
2026-03-30 09:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR25970/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47c26806-e8f8-50aa-80bd-9d78435787a7 with identifier: TU90316
2026-03-30 09:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47c26806-e8f8-50aa-80bd-9d78435787a7 with identifier: TU90316
2026-03-30 09:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 47c26806-e8f8-50aa-80bd-9d78435787a7 with identifier: TU90316 to the API
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:32:44Z',
 'fuel_type': 'diesel',
 'id': '47c26806-e8f8-50aa-80bd-9d78435787a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU90316',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 166400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-24',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2016}
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU90316%27 HTTP/1.1" 200 None
2026-03-30 09:03:12 [auto1.it] INFO: Saving data for TU90316: {'auction_closing_time': 1774971164.0, 'created_time': 1774472583.275457, 'last_price_update_time': 1774861392.106936}
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TU90316') HTTP/1.1" 204 0
2026-03-30 09:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e9b0d0>
2026-03-30 09:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_c0f36c8668f3a68b20743c51f8ac8236.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_c0f36c8668f3a68b20743c51f8ac8236.jpg saved to cache
2026-03-30 09:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7
2026-03-30 09:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062fad10>
2026-03-30 09:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_c3463ab95aed3b3b66d8b2d6473e536a.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_c3463ab95aed3b3b66d8b2d6473e536a.jpg saved to cache
2026-03-30 09:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7
2026-03-30 09:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06240250>
2026-03-30 09:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_4fbcfc19879e8eed670347a71d52a1c3.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_4fbcfc19879e8eed670347a71d52a1c3.jpg saved to cache
2026-03-30 09:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7
2026-03-30 09:03:12 [auto1.it] INFO: Found listing with ID: MX50027
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX50027%27 HTTP/1.1" 200 None
2026-03-30 09:03:12 [auto1.it] INFO: Scrape type for MX50027: 2
2026-03-30 09:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0c3ed69-fbec-5143-aea0-9f5d807ed5ba with identifier: MX50027
2026-03-30 09:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0c3ed69-fbec-5143-aea0-9f5d807ed5ba with scrape type 2
2026-03-30 09:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0c3ed69-fbec-5143-aea0-9f5d807ed5ba with scrape type 2
2026-03-30 09:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b0c3ed69-fbec-5143-aea0-9f5d807ed5ba, identifier: MX50027
2026-03-30 09:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_2f91e07b08c04665352b860c079027eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_4699bfad68e701e470a0cd45a4bdfde3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_a90aaa85c4e1b3020e98ca761b302a57.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b0c3ed69-fbec-5143-aea0-9f5d807ed5ba with identifier: MX50027
2026-03-30 09:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b0c3ed69-fbec-5143-aea0-9f5d807ed5ba with identifier: MX50027
2026-03-30 09:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b0c3ed69-fbec-5143-aea0-9f5d807ed5ba with identifier: MX50027 to the API
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:41:36Z',
 'fuel_type': 'gas',
 'id': 'b0c3ed69-fbec-5143-aea0-9f5d807ed5ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX50027',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 187973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-16',
 'seller_name': None,
 'title': 'Hyundai ix20 1.6 LPG App Mode Blue',
 'transmission': 'manual',
 'trim': 'App Mode Blue',
 'year': 2019}
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX50027%27 HTTP/1.1" 200 None
2026-03-30 09:03:12 [auto1.it] INFO: Saving data for MX50027: {'auction_closing_time': 1774971696.0, 'created_time': 1774342847.152204, 'last_price_update_time': 1774861392.692819}
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MX50027') HTTP/1.1" 204 0
2026-03-30 09:03:12 [auto1.it] INFO: Found listing with ID: GZ10906
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ10906%27 HTTP/1.1" 200 None
2026-03-30 09:03:12 [auto1.it] INFO: Scrape type for GZ10906: 2
2026-03-30 09:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af6a5836-b71e-5134-b699-d52cbb956346 with identifier: GZ10906
2026-03-30 09:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af6a5836-b71e-5134-b699-d52cbb956346 with scrape type 2
2026-03-30 09:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af6a5836-b71e-5134-b699-d52cbb956346 with scrape type 2
2026-03-30 09:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af6a5836-b71e-5134-b699-d52cbb956346, identifier: GZ10906
2026-03-30 09:03:12 [auto1.it] INFO: Channel: 24h | Page: 14 | totalHits: 3295 | hits on page: 40
2026-03-30 09:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af6a5836-b71e-5134-b699-d52cbb956346 with identifier: GZ10906
2026-03-30 09:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af6a5836-b71e-5134-b699-d52cbb956346 with identifier: GZ10906
2026-03-30 09:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af6a5836-b71e-5134-b699-d52cbb956346 with identifier: GZ10906 to the API
2026-03-30 09:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:45:25Z',
 'fuel_type': 'petrol',
 'id': 'af6a5836-b71e-5134-b699-d52cbb956346',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ10906',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 83778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-26',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 PureTech Feel Business',
 'transmission': 'automatic',
 'trim': 'Feel Business',
 'year': 2018}
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ10906%27 HTTP/1.1" 200 None
2026-03-30 09:03:13 [auto1.it] INFO: Saving data for GZ10906: {'auction_closing_time': 1774971925.0, 'created_time': 1773327696.439531, 'last_price_update_time': 1774861393.16494}
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ10906') HTTP/1.1" 204 0
2026-03-30 09:03:13 [auto1.it] INFO: Found listing with ID: PH85251
2026-03-30 09:03:13 [auto1.it] INFO: Found listing with ID: HG99110
2026-03-30 09:03:13 [auto1.it] INFO: Found listing with ID: LS67474
2026-03-30 09:03:13 [auto1.it] INFO: Found listing with ID: WG28581
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG28581%27 HTTP/1.1" 200 None
2026-03-30 09:03:13 [auto1.it] INFO: Scrape type for WG28581: 1
2026-03-30 09:03:13 [auto1.it] INFO: Found listing with ID: NC77836
2026-03-30 09:03:13 [auto1.it] INFO: Found listing with ID: TT40811
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT40811%27 HTTP/1.1" 200 None
2026-03-30 09:03:13 [auto1.it] INFO: Scrape type for TT40811: 2
2026-03-30 09:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17d95586-d117-56ea-98af-1aab3d918ffc with identifier: TT40811
2026-03-30 09:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17d95586-d117-56ea-98af-1aab3d918ffc with scrape type 2
2026-03-30 09:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17d95586-d117-56ea-98af-1aab3d918ffc with scrape type 2
2026-03-30 09:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 17d95586-d117-56ea-98af-1aab3d918ffc, identifier: TT40811
2026-03-30 09:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 17d95586-d117-56ea-98af-1aab3d918ffc with identifier: TT40811
2026-03-30 09:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 17d95586-d117-56ea-98af-1aab3d918ffc with identifier: TT40811
2026-03-30 09:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 17d95586-d117-56ea-98af-1aab3d918ffc with identifier: TT40811 to the API
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:46:10Z',
 'fuel_type': 'petrol',
 'id': '17d95586-d117-56ea-98af-1aab3d918ffc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT40811',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 197573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-29',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.2 MyLife',
 'transmission': 'manual',
 'trim': 'MyLife',
 'year': 2011}
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT40811%27 HTTP/1.1" 200 None
2026-03-30 09:03:13 [auto1.it] INFO: Saving data for TT40811: {'auction_closing_time': 1774971970.0, 'created_time': 1773267551.275263, 'last_price_update_time': 1774861393.666794}
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TT40811') HTTP/1.1" 204 0
2026-03-30 09:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e34250>
2026-03-30 09:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_2f91e07b08c04665352b860c079027eb.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_2f91e07b08c04665352b860c079027eb.jpg saved to cache
2026-03-30 09:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f
2026-03-30 09:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e89710>
2026-03-30 09:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F7e%252F057e39d8b407ce4002e5c7a24de3d54d%252Fpa%252FFJ15819_4699bfad68e701e470a0cd45a4bdfde3.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_4699bfad68e701e470a0cd45a4bdfde3.jpg saved to cache
2026-03-30 09:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7
2026-03-30 09:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb311afc-46b5-5598-a34e-d1a3af7ce8f7, skipping ID generation
2026-03-30 09:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7 with scrape type 1
2026-03-30 09:03:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb311afc-46b5-5598-a34e-d1a3af7ce8f7 sending to next pipeline
2026-03-30 09:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cb311afc-46b5-5598-a34e-d1a3af7ce8f7, identifier: FJ15819
2026-03-30 09:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06eaaf10>
2026-03-30 09:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_a90aaa85c4e1b3020e98ca761b302a57.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_a90aaa85c4e1b3020e98ca761b302a57.jpg saved to cache
2026-03-30 09:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f
2026-03-30 09:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_bae66a4de7db4b88e429a7e5f3a0f9a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:13 [auto1.it] INFO: Found listing with ID: NN97027
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN97027%27 HTTP/1.1" 200 None
2026-03-30 09:03:13 [auto1.it] INFO: Scrape type for NN97027: 2
2026-03-30 09:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46c8246a-bbb2-5319-9f20-920ede0bbe94 with identifier: NN97027
2026-03-30 09:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46c8246a-bbb2-5319-9f20-920ede0bbe94 with scrape type 2
2026-03-30 09:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46c8246a-bbb2-5319-9f20-920ede0bbe94 with scrape type 2
2026-03-30 09:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 46c8246a-bbb2-5319-9f20-920ede0bbe94, identifier: NN97027
2026-03-30 09:03:14 [auto1.it] INFO: Found listing with ID: AF16570
2026-03-30 09:03:14 [auto1.it] INFO: Found listing with ID: CE09318
2026-03-30 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE09318%27 HTTP/1.1" 200 None
2026-03-30 09:03:14 [auto1.it] INFO: Scrape type for CE09318: 2
2026-03-30 09:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7db6a377-5b85-5b31-b346-d63cfa526b84 with identifier: CE09318
2026-03-30 09:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7db6a377-5b85-5b31-b346-d63cfa526b84 with scrape type 2
2026-03-30 09:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7db6a377-5b85-5b31-b346-d63cfa526b84 with scrape type 2
2026-03-30 09:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7db6a377-5b85-5b31-b346-d63cfa526b84, identifier: CE09318
2026-03-30 09:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH15669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cb311afc-46b5-5598-a34e-d1a3af7ce8f7 with identifier: FJ15819
2026-03-30 09:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cb311afc-46b5-5598-a34e-d1a3af7ce8f7 with identifier: FJ15819
2026-03-30 09:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cb311afc-46b5-5598-a34e-d1a3af7ce8f7 with identifier: FJ15819 to the API
2026-03-30 09:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_4699bfad68e701e470a0cd45a4bdfde3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:47:22Z',
 'fuel_type': 'diesel',
 'id': 'cb311afc-46b5-5598-a34e-d1a3af7ce8f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ15819',
 'listing': 'auction',
 'location': 'IT, Varese',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 160079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_4699bfad68e701e470a0cd45a4bdfde3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_c0f36c8668f3a68b20743c51f8ac8236.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_6e1f7a8545cf18e508602d1e0fcfe6c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_4ee1a5f961c52f5ae192d08f948948fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_650c3c844cd3e2d42ad826357bec2c2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_3f0ffbaff18d6b911dcc9e2dae8cf486.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_c31018876a093431e9be9bbe371c6a74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_c3463ab95aed3b3b66d8b2d6473e536a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_7b1cc37cd07edc68be7891328bfdacb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb311afc-46b5-5598-a34e-d1a3af7ce8f7/cb311afc-46b5-5598-a34e-d1a3af7ce8f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/7e/057e39d8b407ce4002e5c7a24de3d54d/pa/FJ15819_4fbcfc19879e8eed670347a71d52a1c3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.2 D-4D Crossover Exclusive',
 'transmission': 'manual',
 'trim': 'Crossover Exclusive',
 'year': 2011}
2026-03-30 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ15819%27 HTTP/1.1" 200 None
2026-03-30 09:03:14 [auto1.it] INFO: Saving data for FJ15819: {'created_time': 1774861394.552802, 'last_price_update_time': 1774861394.552814, 'auction_closing_time': 1774972042.0}
2026-03-30 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FJ15819') HTTP/1.1" 204 0
2026-03-30 09:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 46c8246a-bbb2-5319-9f20-920ede0bbe94 with identifier: NN97027
2026-03-30 09:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 46c8246a-bbb2-5319-9f20-920ede0bbe94 with identifier: NN97027
2026-03-30 09:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 46c8246a-bbb2-5319-9f20-920ede0bbe94 with identifier: NN97027 to the API
2026-03-30 09:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:21:44Z',
 'fuel_type': 'petrol',
 'id': '46c8246a-bbb2-5319-9f20-920ede0bbe94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN97027',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 59476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-27',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line Design',
 'transmission': 'automatic',
 'trim': 'ST-Line Design',
 'year': 2023}
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN97027%27 HTTP/1.1" 200 None
2026-03-30 09:03:15 [auto1.it] INFO: Saving data for NN97027: {'auction_closing_time': 1774970504.0, 'created_time': 1773910933.797993, 'last_price_update_time': 1774861395.01775}
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NN97027') HTTP/1.1" 204 0
2026-03-30 09:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7db6a377-5b85-5b31-b346-d63cfa526b84 with identifier: CE09318
2026-03-30 09:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7db6a377-5b85-5b31-b346-d63cfa526b84 with identifier: CE09318
2026-03-30 09:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7db6a377-5b85-5b31-b346-d63cfa526b84 with identifier: CE09318 to the API
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:11:46Z',
 'fuel_type': 'diesel',
 'id': '7db6a377-5b85-5b31-b346-d63cfa526b84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE09318',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 330635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-24',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2012}
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE09318%27 HTTP/1.1" 200 None
2026-03-30 09:03:15 [auto1.it] INFO: Saving data for CE09318: {'auction_closing_time': 1774969906.0, 'created_time': 1773478824.019001, 'last_price_update_time': 1774861395.368982}
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CE09318') HTTP/1.1" 204 0
2026-03-30 09:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:15 [auto1.it] INFO: Found listing with ID: LC35627
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC35627%27 HTTP/1.1" 200 None
2026-03-30 09:03:15 [auto1.it] INFO: Scrape type for LC35627: 2
2026-03-30 09:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de7a62a2-d399-5423-aafe-e8a21b731e51 with identifier: LC35627
2026-03-30 09:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de7a62a2-d399-5423-aafe-e8a21b731e51 with scrape type 2
2026-03-30 09:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de7a62a2-d399-5423-aafe-e8a21b731e51 with scrape type 2
2026-03-30 09:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: de7a62a2-d399-5423-aafe-e8a21b731e51, identifier: LC35627
2026-03-30 09:03:15 [auto1.it] INFO: Found listing with ID: MG39360
2026-03-30 09:03:15 [auto1.it] INFO: Found listing with ID: WJ69622
2026-03-30 09:03:15 [auto1.it] INFO: Found listing with ID: SD48843
2026-03-30 09:03:15 [auto1.it] INFO: Found listing with ID: GG46120
2026-03-30 09:03:15 [auto1.it] INFO: Found listing with ID: SC05830
2026-03-30 09:03:15 [auto1.it] INFO: Found listing with ID: EV67408
2026-03-30 09:03:15 [auto1.it] INFO: Found listing with ID: EC33452
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC33452%27 HTTP/1.1" 200 None
2026-03-30 09:03:15 [auto1.it] INFO: Scrape type for EC33452: 2
2026-03-30 09:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77481998-c980-548c-9125-d11a0853bad0 with identifier: EC33452
2026-03-30 09:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77481998-c980-548c-9125-d11a0853bad0 with scrape type 2
2026-03-30 09:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77481998-c980-548c-9125-d11a0853bad0 with scrape type 2
2026-03-30 09:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 77481998-c980-548c-9125-d11a0853bad0, identifier: EC33452
2026-03-30 09:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: de7a62a2-d399-5423-aafe-e8a21b731e51 with identifier: LC35627
2026-03-30 09:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: de7a62a2-d399-5423-aafe-e8a21b731e51 with identifier: LC35627
2026-03-30 09:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: de7a62a2-d399-5423-aafe-e8a21b731e51 with identifier: LC35627 to the API
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:37:37Z',
 'fuel_type': 'diesel',
 'id': 'de7a62a2-d399-5423-aafe-e8a21b731e51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC35627',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 39761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-13',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 d Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-30 09:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC35627%27 HTTP/1.1" 200 None
2026-03-30 09:03:16 [auto1.it] INFO: Saving data for LC35627: {'auction_closing_time': 1774971457.0, 'created_time': 1773663420.730041, 'last_price_update_time': 1774861396.013904}
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC35627') HTTP/1.1" 204 0
2026-03-30 09:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 77481998-c980-548c-9125-d11a0853bad0 with identifier: EC33452
2026-03-30 09:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 77481998-c980-548c-9125-d11a0853bad0 with identifier: EC33452
2026-03-30 09:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 77481998-c980-548c-9125-d11a0853bad0 with identifier: EC33452 to the API
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:03:54Z',
 'fuel_type': 'petrol',
 'id': '77481998-c980-548c-9125-d11a0853bad0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC33452',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 98955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Citroen DS3 1.4 VTi Chic',
 'transmission': 'manual',
 'trim': 'Chic',
 'year': 2012}
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC33452%27 HTTP/1.1" 200 None
2026-03-30 09:03:16 [auto1.it] INFO: Saving data for EC33452: {'auction_closing_time': 1774969434.0, 'created_time': 1773926866.189369, 'last_price_update_time': 1774861396.351808}
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC33452') HTTP/1.1" 204 0
2026-03-30 09:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_bd315e32fe2e132b22ef9db63ab62b38.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:16 [auto1.it] INFO: Found listing with ID: TD45829
2026-03-30 09:03:16 [auto1.it] INFO: Found listing with ID: MB23093
2026-03-30 09:03:16 [auto1.it] INFO: Found listing with ID: FH22196
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH22196%27 HTTP/1.1" 200 None
2026-03-30 09:03:16 [auto1.it] INFO: Scrape type for FH22196: 2
2026-03-30 09:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e603fb94-a92e-5cc6-b3d4-d73ff2bdca7f with identifier: FH22196
2026-03-30 09:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e603fb94-a92e-5cc6-b3d4-d73ff2bdca7f with scrape type 2
2026-03-30 09:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e603fb94-a92e-5cc6-b3d4-d73ff2bdca7f with scrape type 2
2026-03-30 09:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e603fb94-a92e-5cc6-b3d4-d73ff2bdca7f, identifier: FH22196
2026-03-30 09:03:16 [auto1.it] INFO: Found listing with ID: CV62006
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV62006%27 HTTP/1.1" 200 None
2026-03-30 09:03:16 [auto1.it] INFO: Scrape type for CV62006: 2
2026-03-30 09:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdc24622-ea3c-5fee-90e5-db2d88d9027f with identifier: CV62006
2026-03-30 09:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdc24622-ea3c-5fee-90e5-db2d88d9027f with scrape type 2
2026-03-30 09:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdc24622-ea3c-5fee-90e5-db2d88d9027f with scrape type 2
2026-03-30 09:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cdc24622-ea3c-5fee-90e5-db2d88d9027f, identifier: CV62006
2026-03-30 09:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH42786> (referer: https://www.auto1.com/v1/car-details-view/AH42786/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE87600> (referer: https://www.auto1.com/v1/car-details-view/KE87600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW20152/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e1aab4490>
2026-03-30 09:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_bae66a4de7db4b88e429a7e5f3a0f9a0.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_bae66a4de7db4b88e429a7e5f3a0f9a0.jpg saved to cache
2026-03-30 09:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b767cebb-7d47-58e7-bed7-591a8c61d7d3
2026-03-30 09:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_bffbc21b52d1c86f4d074e90a476c6cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e603fb94-a92e-5cc6-b3d4-d73ff2bdca7f with identifier: FH22196
2026-03-30 09:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e603fb94-a92e-5cc6-b3d4-d73ff2bdca7f with identifier: FH22196
2026-03-30 09:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e603fb94-a92e-5cc6-b3d4-d73ff2bdca7f with identifier: FH22196 to the API
2026-03-30 09:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:02:23Z',
 'fuel_type': 'petrol',
 'id': 'e603fb94-a92e-5cc6-b3d4-d73ff2bdca7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH22196',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 32135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-12',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH22196%27 HTTP/1.1" 200 None
2026-03-30 09:03:17 [auto1.it] INFO: Saving data for FH22196: {'auction_closing_time': 1774969343.0, 'created_time': 1773522171.665108, 'last_price_update_time': 1774861397.295424}
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FH22196') HTTP/1.1" 204 0
2026-03-30 09:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cdc24622-ea3c-5fee-90e5-db2d88d9027f with identifier: CV62006
2026-03-30 09:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cdc24622-ea3c-5fee-90e5-db2d88d9027f with identifier: CV62006
2026-03-30 09:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cdc24622-ea3c-5fee-90e5-db2d88d9027f with identifier: CV62006 to the API
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-31T15:46:08Z',
 'fuel_type': 'petrol',
 'id': 'cdc24622-ea3c-5fee-90e5-db2d88d9027f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV62006',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Freelander',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-06-06',
 'seller_name': None,
 'title': 'Land Rover Freelander 1.8 Hardback',
 'transmission': 'manual',
 'trim': 'Hardback',
 'year': 2001}
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV62006%27 HTTP/1.1" 200 None
2026-03-30 09:03:17 [auto1.it] INFO: Saving data for CV62006: {'auction_closing_time': 1774971968.0, 'created_time': 1774612948.381977, 'last_price_update_time': 1774861397.830093}
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV62006') HTTP/1.1" 204 0
2026-03-30 09:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK64224> (referer: https://www.auto1.com/v1/car-details-view/JK64224/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_183d3c150924b1087b74ead5abb34083.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:17 [auto1.it] INFO: Found listing with ID: GS44368
2026-03-30 09:03:17 [auto1.it] INFO: Found listing with ID: SC01107
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC01107%27 HTTP/1.1" 200 None
2026-03-30 09:03:17 [auto1.it] INFO: Scrape type for SC01107: 2
2026-03-30 09:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21576f4a-92e7-5014-8f27-3991330ebc1c with identifier: SC01107
2026-03-30 09:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21576f4a-92e7-5014-8f27-3991330ebc1c with scrape type 2
2026-03-30 09:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21576f4a-92e7-5014-8f27-3991330ebc1c with scrape type 2
2026-03-30 09:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 21576f4a-92e7-5014-8f27-3991330ebc1c, identifier: SC01107
2026-03-30 09:03:17 [auto1.it] INFO: Found listing with ID: KZ82470
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ82470%27 HTTP/1.1" 200 None
2026-03-30 09:03:17 [auto1.it] INFO: Scrape type for KZ82470: 2
2026-03-30 09:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f85cc4af-a34b-5ed2-a921-ddbf8d2d0a8f with identifier: KZ82470
2026-03-30 09:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f85cc4af-a34b-5ed2-a921-ddbf8d2d0a8f with scrape type 2
2026-03-30 09:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f85cc4af-a34b-5ed2-a921-ddbf8d2d0a8f with scrape type 2
2026-03-30 09:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f85cc4af-a34b-5ed2-a921-ddbf8d2d0a8f, identifier: KZ82470
2026-03-30 09:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_8f31f2a4d337c3afc00f0212734b40ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_e56039c97cfa6e8dfedca70a9eff7e49.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 21576f4a-92e7-5014-8f27-3991330ebc1c with identifier: SC01107
2026-03-30 09:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 21576f4a-92e7-5014-8f27-3991330ebc1c with identifier: SC01107
2026-03-30 09:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 21576f4a-92e7-5014-8f27-3991330ebc1c with identifier: SC01107 to the API
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:49:24Z',
 'fuel_type': 'diesel',
 'id': '21576f4a-92e7-5014-8f27-3991330ebc1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC01107',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 119949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Business BlueMotion Tech',
 'year': 2016}
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC01107%27 HTTP/1.1" 200 None
2026-03-30 09:03:18 [auto1.it] INFO: Saving data for SC01107: {'auction_closing_time': 1774972164.0, 'created_time': 1773349439.510521, 'last_price_update_time': 1774861398.41168}
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC01107') HTTP/1.1" 204 0
2026-03-30 09:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f85cc4af-a34b-5ed2-a921-ddbf8d2d0a8f with identifier: KZ82470
2026-03-30 09:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f85cc4af-a34b-5ed2-a921-ddbf8d2d0a8f with identifier: KZ82470
2026-03-30 09:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f85cc4af-a34b-5ed2-a921-ddbf8d2d0a8f with identifier: KZ82470 to the API
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:09:09Z',
 'fuel_type': 'diesel',
 'id': 'f85cc4af-a34b-5ed2-a921-ddbf8d2d0a8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ82470',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 218594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Vignale',
 'transmission': 'automatic',
 'trim': 'Vignale',
 'year': 2018}
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ82470%27 HTTP/1.1" 200 None
2026-03-30 09:03:18 [auto1.it] INFO: Saving data for KZ82470: {'auction_closing_time': 1774969749.0, 'created_time': 1773267483.278146, 'last_price_update_time': 1774861398.793885}
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KZ82470') HTTP/1.1" 204 0
2026-03-30 09:03:18 [auto1.it] INFO: Found listing with ID: PV08613
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV08613%27 HTTP/1.1" 200 None
2026-03-30 09:03:18 [auto1.it] INFO: Scrape type for PV08613: 2
2026-03-30 09:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0fb1e0f-bc1f-5c12-bc8e-ba6dff9c6fd0 with identifier: PV08613
2026-03-30 09:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0fb1e0f-bc1f-5c12-bc8e-ba6dff9c6fd0 with scrape type 2
2026-03-30 09:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0fb1e0f-bc1f-5c12-bc8e-ba6dff9c6fd0 with scrape type 2
2026-03-30 09:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c0fb1e0f-bc1f-5c12-bc8e-ba6dff9c6fd0, identifier: PV08613
2026-03-30 09:03:18 [auto1.it] INFO: Found listing with ID: GU28571
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU28571%27 HTTP/1.1" 200 None
2026-03-30 09:03:18 [auto1.it] INFO: Scrape type for GU28571: 2
2026-03-30 09:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4041458-9abb-570f-933d-c8a200d7c8a3 with identifier: GU28571
2026-03-30 09:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4041458-9abb-570f-933d-c8a200d7c8a3 with scrape type 2
2026-03-30 09:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4041458-9abb-570f-933d-c8a200d7c8a3 with scrape type 2
2026-03-30 09:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4041458-9abb-570f-933d-c8a200d7c8a3, identifier: GU28571
2026-03-30 09:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c0fb1e0f-bc1f-5c12-bc8e-ba6dff9c6fd0 with identifier: PV08613
2026-03-30 09:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c0fb1e0f-bc1f-5c12-bc8e-ba6dff9c6fd0 with identifier: PV08613
2026-03-30 09:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c0fb1e0f-bc1f-5c12-bc8e-ba6dff9c6fd0 with identifier: PV08613 to the API
2026-03-30 09:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:19:19Z',
 'fuel_type': 'diesel',
 'id': 'c0fb1e0f-bc1f-5c12-bc8e-ba6dff9c6fd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV08613',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 74837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-30',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-30 09:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV08613%27 HTTP/1.1" 200 None
2026-03-30 09:03:19 [auto1.it] INFO: Saving data for PV08613: {'auction_closing_time': 1774970359.0, 'created_time': 1774472518.396694, 'last_price_update_time': 1774861399.54996}
2026-03-30 09:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PV08613') HTTP/1.1" 204 0
2026-03-30 09:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4041458-9abb-570f-933d-c8a200d7c8a3 with identifier: GU28571
2026-03-30 09:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4041458-9abb-570f-933d-c8a200d7c8a3 with identifier: GU28571
2026-03-30 09:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4041458-9abb-570f-933d-c8a200d7c8a3 with identifier: GU28571 to the API
2026-03-30 09:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:28:25Z',
 'fuel_type': 'petrol',
 'id': 'b4041458-9abb-570f-933d-c8a200d7c8a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU28571',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 247408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-30 09:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU28571%27 HTTP/1.1" 200 None
2026-03-30 09:03:19 [auto1.it] INFO: Saving data for GU28571: {'auction_closing_time': 1774970905.0, 'created_time': 1773136055.78475, 'last_price_update_time': 1774861399.916393}
2026-03-30 09:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GU28571') HTTP/1.1" 204 0
2026-03-30 09:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0635bdd0>
2026-03-30 09:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_bd315e32fe2e132b22ef9db63ab62b38.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_bd315e32fe2e132b22ef9db63ab62b38.jpg saved to cache
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea036585-d06d-57db-92c9-a238b1e2a9ac
2026-03-30 09:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b254d90-a747-52c8-9427-02d30dfb1c18 with identifier: AH42786
2026-03-30 09:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b254d90-a747-52c8-9427-02d30dfb1c18 with scrape type 1
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b254d90-a747-52c8-9427-02d30dfb1c18
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_996541d9890fa820c898059372742a89.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_996541d9890fa820c898059372742a89.jpg not downloaded yet
2026-03-30 09:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf4abfc-a350-5414-81ab-b445c5b6c412 with identifier: KE87600
2026-03-30 09:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf4abfc-a350-5414-81ab-b445c5b6c412 with scrape type 1
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item faf4abfc-a350-5414-81ab-b445c5b6c412
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F7b%252Fa27b2ba28a1976ce52f6f607f7117942%252Fpa%252FKE87600_0a112dd9fc7e6584b40cb030df62e7d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_0a112dd9fc7e6584b40cb030df62e7d0.jpg not downloaded yet
2026-03-30 09:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06228210>
2026-03-30 09:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_bffbc21b52d1c86f4d074e90a476c6cb.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_bffbc21b52d1c86f4d074e90a476c6cb.jpg saved to cache
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b767cebb-7d47-58e7-bed7-591a8c61d7d3
2026-03-30 09:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 495baa54-75b7-5083-acf4-ff097e0e9f1e with identifier: JK64224
2026-03-30 09:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 495baa54-75b7-5083-acf4-ff097e0e9f1e with scrape type 1
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 495baa54-75b7-5083-acf4-ff097e0e9f1e
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F75%252Fe775227d02e6732717c8816f30dfe4e5%252Fpa%252FJK64224_31910b6785b986394afa89e33384222d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_31910b6785b986394afa89e33384222d.jpg already downloaded
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F75%252Fe775227d02e6732717c8816f30dfe4e5%252Fpa%252FJK64224_fcf710d4defcc5d6bcbf67bd614f0daa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_fcf710d4defcc5d6bcbf67bd614f0daa.jpg already downloaded
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F75%252Fe775227d02e6732717c8816f30dfe4e5%252Fpa%252FJK64224_78a42ae4e389af1382ced20e71866588.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_78a42ae4e389af1382ced20e71866588.jpg already downloaded
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F75%252Fe775227d02e6732717c8816f30dfe4e5%252Fpa%252FJK64224_a382c82ac834cfd8ffb6df5e330e66d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_a382c82ac834cfd8ffb6df5e330e66d6.jpg already downloaded
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F75%252Fe775227d02e6732717c8816f30dfe4e5%252Fpa%252FJK64224_955475ba8de23f0fac87e7ede1c6a9ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_955475ba8de23f0fac87e7ede1c6a9ea.jpg already downloaded
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F75%252Fe775227d02e6732717c8816f30dfe4e5%252Fpa%252FJK64224_933bf89a2362538e00a4c01549d75c6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_933bf89a2362538e00a4c01549d75c6f.jpg already downloaded
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F75%252Fe775227d02e6732717c8816f30dfe4e5%252Fpa%252FJK64224_137d85ff74a6d8bb1ba7ddfbc4e5a4e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_137d85ff74a6d8bb1ba7ddfbc4e5a4e7.jpg already downloaded
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F75%252Fe775227d02e6732717c8816f30dfe4e5%252Fpa%252FJK64224_3248f63da7f28a75d7a06281a893abb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_3248f63da7f28a75d7a06281a893abb1.jpg already downloaded
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F75%252Fe775227d02e6732717c8816f30dfe4e5%252Fpa%252FJK64224_ea0f77f1ab363f57cb4b2d15538d977e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_ea0f77f1ab363f57cb4b2d15538d977e.jpg already downloaded
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F75%252Fe775227d02e6732717c8816f30dfe4e5%252Fpa%252FJK64224_927c0d008db8f2e42d23845d640176fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_927c0d008db8f2e42d23845d640176fa.jpg already downloaded
2026-03-30 09:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 495baa54-75b7-5083-acf4-ff097e0e9f1e, identifier: JK64224
2026-03-30 09:03:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d53290>
2026-03-30 09:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_183d3c150924b1087b74ead5abb34083.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_183d3c150924b1087b74ead5abb34083.jpg saved to cache
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea036585-d06d-57db-92c9-a238b1e2a9ac
2026-03-30 09:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_f7950747e783e12b2aee9c919bb73e83.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:20 [auto1.it] INFO: Found listing with ID: DW05477
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW05477%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [auto1.it] INFO: Scrape type for DW05477: 2
2026-03-30 09:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f5284c-3028-511e-af5b-a8f952977581 with identifier: DW05477
2026-03-30 09:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f5284c-3028-511e-af5b-a8f952977581 with scrape type 2
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55f5284c-3028-511e-af5b-a8f952977581 with scrape type 2
2026-03-30 09:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 55f5284c-3028-511e-af5b-a8f952977581, identifier: DW05477
2026-03-30 09:03:20 [auto1.it] INFO: Found listing with ID: JR58034
2026-03-30 09:03:20 [auto1.it] INFO: Found listing with ID: CE19037
2026-03-30 09:03:20 [auto1.it] INFO: Found listing with ID: LS03457
2026-03-30 09:03:20 [auto1.it] INFO: Found listing with ID: BV26472
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV26472%27 HTTP/1.1" 200 None
2026-03-30 09:03:20 [auto1.it] INFO: Scrape type for BV26472: 2
2026-03-30 09:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6617b43-fa48-5410-bc18-6c5797f3ed00 with identifier: BV26472
2026-03-30 09:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6617b43-fa48-5410-bc18-6c5797f3ed00 with scrape type 2
2026-03-30 09:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6617b43-fa48-5410-bc18-6c5797f3ed00 with scrape type 2
2026-03-30 09:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6617b43-fa48-5410-bc18-6c5797f3ed00, identifier: BV26472
2026-03-30 09:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 495baa54-75b7-5083-acf4-ff097e0e9f1e with identifier: JK64224
2026-03-30 09:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 495baa54-75b7-5083-acf4-ff097e0e9f1e with identifier: JK64224
2026-03-30 09:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 495baa54-75b7-5083-acf4-ff097e0e9f1e with identifier: JK64224 to the API
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JK64224>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:27:06Z',
 'fuel_type': 'petrol',
 'id': '495baa54-75b7-5083-acf4-ff097e0e9f1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK64224',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 74848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_31910b6785b986394afa89e33384222d.jpg',
                'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_fcf710d4defcc5d6bcbf67bd614f0daa.jpg',
                'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_78a42ae4e389af1382ced20e71866588.jpg',
                'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_a382c82ac834cfd8ffb6df5e330e66d6.jpg',
                'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_955475ba8de23f0fac87e7ede1c6a9ea.jpg',
                'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_933bf89a2362538e00a4c01549d75c6f.jpg',
                'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_137d85ff74a6d8bb1ba7ddfbc4e5a4e7.jpg',
                'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_3248f63da7f28a75d7a06281a893abb1.jpg',
                'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_ea0f77f1ab363f57cb4b2d15538d977e.jpg',
                'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_927c0d008db8f2e42d23845d640176fa.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d3a1629-1b39-5fb9-805d-db8ace48a65c/2d3a1629-1b39-5fb9-805d-db8ace48a65c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_31910b6785b986394afa89e33384222d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d3a1629-1b39-5fb9-805d-db8ace48a65c/2d3a1629-1b39-5fb9-805d-db8ace48a65c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_fcf710d4defcc5d6bcbf67bd614f0daa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d3a1629-1b39-5fb9-805d-db8ace48a65c/2d3a1629-1b39-5fb9-805d-db8ace48a65c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_78a42ae4e389af1382ced20e71866588.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d3a1629-1b39-5fb9-805d-db8ace48a65c/2d3a1629-1b39-5fb9-805d-db8ace48a65c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_a382c82ac834cfd8ffb6df5e330e66d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d3a1629-1b39-5fb9-805d-db8ace48a65c/2d3a1629-1b39-5fb9-805d-db8ace48a65c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_955475ba8de23f0fac87e7ede1c6a9ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d3a1629-1b39-5fb9-805d-db8ace48a65c/2d3a1629-1b39-5fb9-805d-db8ace48a65c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_933bf89a2362538e00a4c01549d75c6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d3a1629-1b39-5fb9-805d-db8ace48a65c/2d3a1629-1b39-5fb9-805d-db8ace48a65c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_137d85ff74a6d8bb1ba7ddfbc4e5a4e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d3a1629-1b39-5fb9-805d-db8ace48a65c/2d3a1629-1b39-5fb9-805d-db8ace48a65c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_3248f63da7f28a75d7a06281a893abb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d3a1629-1b39-5fb9-805d-db8ace48a65c/2d3a1629-1b39-5fb9-805d-db8ace48a65c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_ea0f77f1ab363f57cb4b2d15538d977e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d3a1629-1b39-5fb9-805d-db8ace48a65c/2d3a1629-1b39-5fb9-805d-db8ace48a65c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/75/e775227d02e6732717c8816f30dfe4e5/pa/JK64224_927c0d008db8f2e42d23845d640176fa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2021}
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK64224%27 HTTP/1.1" 200 None
2026-03-30 09:03:21 [auto1.it] INFO: Saving data for JK64224: {'created_time': 1774861401.241094, 'last_price_update_time': 1774861401.241106, 'auction_closing_time': 1774970826.0}
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JK64224') HTTP/1.1" 204 0
2026-03-30 09:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 55f5284c-3028-511e-af5b-a8f952977581 with identifier: DW05477
2026-03-30 09:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 55f5284c-3028-511e-af5b-a8f952977581 with identifier: DW05477
2026-03-30 09:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 55f5284c-3028-511e-af5b-a8f952977581 with identifier: DW05477 to the API
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:30:42Z',
 'fuel_type': 'diesel',
 'id': '55f5284c-3028-511e-af5b-a8f952977581',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW05477',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 201174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-02',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2014}
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW05477%27 HTTP/1.1" 200 None
2026-03-30 09:03:21 [auto1.it] INFO: Saving data for DW05477: {'auction_closing_time': 1774971042.0, 'created_time': 1774447284.055515, 'last_price_update_time': 1774861401.576669}
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DW05477') HTTP/1.1" 204 0
2026-03-30 09:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6617b43-fa48-5410-bc18-6c5797f3ed00 with identifier: BV26472
2026-03-30 09:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6617b43-fa48-5410-bc18-6c5797f3ed00 with identifier: BV26472
2026-03-30 09:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6617b43-fa48-5410-bc18-6c5797f3ed00 with identifier: BV26472 to the API
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:52:34Z',
 'fuel_type': 'petrol',
 'id': 'a6617b43-fa48-5410-bc18-6c5797f3ed00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV26472',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 142690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-29',
 'seller_name': None,
 'title': 'Citroen C3 1.1 Airplay',
 'transmission': 'manual',
 'trim': 'Airplay',
 'year': 2010}
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV26472%27 HTTP/1.1" 200 None
2026-03-30 09:03:22 [auto1.it] INFO: Saving data for BV26472: {'auction_closing_time': 1774972354.0, 'created_time': 1774472486.987897, 'last_price_update_time': 1774861402.065188}
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BV26472') HTTP/1.1" 204 0
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_259942df2803f9b99269fef72f1d3ac9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_259942df2803f9b99269fef72f1d3ac9.jpg not downloaded yet
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F7b%252Fa27b2ba28a1976ce52f6f607f7117942%252Fpa%252FKE87600_9c95b7ac82e2cb9010564f272a7f077e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_9c95b7ac82e2cb9010564f272a7f077e.jpg not downloaded yet
2026-03-30 09:03:22 [auto1.it] INFO: Found listing with ID: PH30098
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH30098%27 HTTP/1.1" 200 None
2026-03-30 09:03:22 [auto1.it] INFO: Scrape type for PH30098: 2
2026-03-30 09:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c178d28-9c79-5afb-85ea-91e7915509ac with identifier: PH30098
2026-03-30 09:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c178d28-9c79-5afb-85ea-91e7915509ac with scrape type 2
2026-03-30 09:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c178d28-9c79-5afb-85ea-91e7915509ac with scrape type 2
2026-03-30 09:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0c178d28-9c79-5afb-85ea-91e7915509ac, identifier: PH30098
2026-03-30 09:03:22 [auto1.it] INFO: Found listing with ID: PS14432
2026-03-30 09:03:22 [auto1.it] INFO: Found listing with ID: SZ24732
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ24732%27 HTTP/1.1" 200 None
2026-03-30 09:03:22 [auto1.it] INFO: Scrape type for SZ24732: 2
2026-03-30 09:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0077fae-884e-54ca-b93b-7dca9b3718ce with identifier: SZ24732
2026-03-30 09:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0077fae-884e-54ca-b93b-7dca9b3718ce with scrape type 2
2026-03-30 09:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0077fae-884e-54ca-b93b-7dca9b3718ce with scrape type 2
2026-03-30 09:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a0077fae-884e-54ca-b93b-7dca9b3718ce, identifier: SZ24732
2026-03-30 09:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f5c710>
2026-03-30 09:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_8f31f2a4d337c3afc00f0212734b40ae.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_8f31f2a4d337c3afc00f0212734b40ae.jpg saved to cache
2026-03-30 09:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0066079f-1ba1-5322-810b-b31ff6e67689
2026-03-30 09:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ca9790>
2026-03-30 09:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_e56039c97cfa6e8dfedca70a9eff7e49.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_e56039c97cfa6e8dfedca70a9eff7e49.jpg saved to cache
2026-03-30 09:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea036585-d06d-57db-92c9-a238b1e2a9ac
2026-03-30 09:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0c178d28-9c79-5afb-85ea-91e7915509ac with identifier: PH30098
2026-03-30 09:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0c178d28-9c79-5afb-85ea-91e7915509ac with identifier: PH30098
2026-03-30 09:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0c178d28-9c79-5afb-85ea-91e7915509ac with identifier: PH30098 to the API
2026-03-30 09:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:18:40Z',
 'fuel_type': 'diesel',
 'id': '0c178d28-9c79-5afb-85ea-91e7915509ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH30098',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 316669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2017}
2026-03-30 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH30098%27 HTTP/1.1" 200 None
2026-03-30 09:03:23 [auto1.it] INFO: Saving data for PH30098: {'auction_closing_time': 1774970320.0, 'created_time': 1773482070.226565, 'last_price_update_time': 1774861403.26482}
2026-03-30 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PH30098') HTTP/1.1" 204 0
2026-03-30 09:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a0077fae-884e-54ca-b93b-7dca9b3718ce with identifier: SZ24732
2026-03-30 09:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a0077fae-884e-54ca-b93b-7dca9b3718ce with identifier: SZ24732
2026-03-30 09:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a0077fae-884e-54ca-b93b-7dca9b3718ce with identifier: SZ24732 to the API
2026-03-30 09:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:15:40Z',
 'fuel_type': 'diesel',
 'id': 'a0077fae-884e-54ca-b93b-7dca9b3718ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ24732',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 274597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ24732%27 HTTP/1.1" 200 None
2026-03-30 09:03:24 [auto1.it] INFO: Saving data for SZ24732: {'auction_closing_time': 1774970140.0, 'created_time': 1772785370.310989, 'last_price_update_time': 1774861404.509428}
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SZ24732') HTTP/1.1" 204 0
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_1d4e926f59f3c397c72f9670556f3716.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_1d4e926f59f3c397c72f9670556f3716.jpg not downloaded yet
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F7b%252Fa27b2ba28a1976ce52f6f607f7117942%252Fpa%252FKE87600_619f702a11ccdc41d2a25ab2105a4c62.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_619f702a11ccdc41d2a25ab2105a4c62.jpg not downloaded yet
2026-03-30 09:03:24 [auto1.it] INFO: Found listing with ID: AL46082
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL46082%27 HTTP/1.1" 200 None
2026-03-30 09:03:24 [auto1.it] INFO: Scrape type for AL46082: 2
2026-03-30 09:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85ee8bc3-b465-5955-a94c-bde93c56ab46 with identifier: AL46082
2026-03-30 09:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85ee8bc3-b465-5955-a94c-bde93c56ab46 with scrape type 2
2026-03-30 09:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85ee8bc3-b465-5955-a94c-bde93c56ab46 with scrape type 2
2026-03-30 09:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 85ee8bc3-b465-5955-a94c-bde93c56ab46, identifier: AL46082
2026-03-30 09:03:24 [auto1.it] INFO: Found listing with ID: PR58597
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR58597%27 HTTP/1.1" 200 None
2026-03-30 09:03:24 [auto1.it] INFO: Scrape type for PR58597: 2
2026-03-30 09:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e532bb81-e312-5bfb-9971-25951396539e with identifier: PR58597
2026-03-30 09:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e532bb81-e312-5bfb-9971-25951396539e with scrape type 2
2026-03-30 09:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e532bb81-e312-5bfb-9971-25951396539e with scrape type 2
2026-03-30 09:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e532bb81-e312-5bfb-9971-25951396539e, identifier: PR58597
2026-03-30 09:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fe4f10>
2026-03-30 09:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b5115d-0763-5fa7-9224-5ab626f7aed2/c6b5115d-0763-5fa7-9224-5ab626f7aed2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc4%252F5bc49a628e55b53fa9fa9543d4c00524%252Fpa%252FSV41912_f7950747e783e12b2aee9c919bb73e83.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_f7950747e783e12b2aee9c919bb73e83.jpg saved to cache
2026-03-30 09:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6b5115d-0763-5fa7-9224-5ab626f7aed2
2026-03-30 09:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 85ee8bc3-b465-5955-a94c-bde93c56ab46 with identifier: AL46082
2026-03-30 09:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 85ee8bc3-b465-5955-a94c-bde93c56ab46 with identifier: AL46082
2026-03-30 09:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 85ee8bc3-b465-5955-a94c-bde93c56ab46 with identifier: AL46082 to the API
2026-03-30 09:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:56:34Z',
 'fuel_type': 'petrol',
 'id': '85ee8bc3-b465-5955-a94c-bde93c56ab46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL46082',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 124097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-18',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Slam',
 'transmission': 'manual',
 'trim': 'Slam',
 'year': 2015}
2026-03-30 09:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL46082%27 HTTP/1.1" 200 None
2026-03-30 09:03:25 [auto1.it] INFO: Saving data for AL46082: {'auction_closing_time': 1774972594.0, 'created_time': 1773922190.855912, 'last_price_update_time': 1774861405.38163}
2026-03-30 09:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL46082') HTTP/1.1" 204 0
2026-03-30 09:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e532bb81-e312-5bfb-9971-25951396539e with identifier: PR58597
2026-03-30 09:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e532bb81-e312-5bfb-9971-25951396539e with identifier: PR58597
2026-03-30 09:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e532bb81-e312-5bfb-9971-25951396539e with identifier: PR58597 to the API
2026-03-30 09:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:11:13Z',
 'fuel_type': 'diesel',
 'id': 'e532bb81-e312-5bfb-9971-25951396539e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR58597',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 127600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 BLUE dCi S-Edition',
 'transmission': 'manual',
 'trim': 'S-Edition',
 'year': 2019}
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR58597%27 HTTP/1.1" 200 None
2026-03-30 09:03:27 [auto1.it] INFO: Saving data for PR58597: {'auction_closing_time': 1774969873.0, 'created_time': 1774101675.291527, 'last_price_update_time': 1774861407.15598}
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR58597') HTTP/1.1" 204 0
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_62c93984919ef2ea34d13229ae9f1ee3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_62c93984919ef2ea34d13229ae9f1ee3.jpg not downloaded yet
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F7b%252Fa27b2ba28a1976ce52f6f607f7117942%252Fpa%252FKE87600_23f158cb59ed63f840d4dc349e7f6a08.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_23f158cb59ed63f840d4dc349e7f6a08.jpg not downloaded yet
2026-03-30 09:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:27 [auto1.it] INFO: Found listing with ID: XT15481
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT15481%27 HTTP/1.1" 200 None
2026-03-30 09:03:27 [auto1.it] INFO: Scrape type for XT15481: 2
2026-03-30 09:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35c6225b-7f45-5adc-9e0a-aef43b49ec9c with identifier: XT15481
2026-03-30 09:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35c6225b-7f45-5adc-9e0a-aef43b49ec9c with scrape type 2
2026-03-30 09:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35c6225b-7f45-5adc-9e0a-aef43b49ec9c with scrape type 2
2026-03-30 09:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 35c6225b-7f45-5adc-9e0a-aef43b49ec9c, identifier: XT15481
2026-03-30 09:03:27 [auto1.it] INFO: Found listing with ID: ME44881
2026-03-30 09:03:27 [auto1.it] INFO: Found listing with ID: VV47439
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV47439%27 HTTP/1.1" 200 None
2026-03-30 09:03:27 [auto1.it] INFO: Scrape type for VV47439: 2
2026-03-30 09:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0f5801d-ba8b-5a9f-96ad-ab6557ab8df0 with identifier: VV47439
2026-03-30 09:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0f5801d-ba8b-5a9f-96ad-ab6557ab8df0 with scrape type 2
2026-03-30 09:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0f5801d-ba8b-5a9f-96ad-ab6557ab8df0 with scrape type 2
2026-03-30 09:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e0f5801d-ba8b-5a9f-96ad-ab6557ab8df0, identifier: VV47439
2026-03-30 09:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 35c6225b-7f45-5adc-9e0a-aef43b49ec9c with identifier: XT15481
2026-03-30 09:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 35c6225b-7f45-5adc-9e0a-aef43b49ec9c with identifier: XT15481
2026-03-30 09:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 35c6225b-7f45-5adc-9e0a-aef43b49ec9c with identifier: XT15481 to the API
2026-03-30 09:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:57:04Z',
 'fuel_type': 'diesel',
 'id': '35c6225b-7f45-5adc-9e0a-aef43b49ec9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT15481',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 106145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-05',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 2007}
2026-03-30 09:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT15481%27 HTTP/1.1" 200 None
2026-03-30 09:03:29 [auto1.it] INFO: Saving data for XT15481: {'auction_closing_time': 1774972624.0, 'created_time': 1773954070.011875, 'last_price_update_time': 1774861409.561124}
2026-03-30 09:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XT15481') HTTP/1.1" 204 0
2026-03-30 09:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e0f5801d-ba8b-5a9f-96ad-ab6557ab8df0 with identifier: VV47439
2026-03-30 09:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e0f5801d-ba8b-5a9f-96ad-ab6557ab8df0 with identifier: VV47439
2026-03-30 09:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e0f5801d-ba8b-5a9f-96ad-ab6557ab8df0 with identifier: VV47439 to the API
2026-03-30 09:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:14:49Z',
 'fuel_type': 'petrol',
 'id': 'e0f5801d-ba8b-5a9f-96ad-ab6557ab8df0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV47439',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 41357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel Pack',
 'transmission': 'manual',
 'trim': 'Feel Pack',
 'year': 2021}
2026-03-30 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV47439%27 HTTP/1.1" 200 None
2026-03-30 09:03:31 [auto1.it] INFO: Saving data for VV47439: {'auction_closing_time': 1774970089.0, 'created_time': 1774447276.930139, 'last_price_update_time': 1774861411.50488}
2026-03-30 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VV47439') HTTP/1.1" 204 0
2026-03-30 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_1b028c1283d4223b8cbb2d853be42932.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_1b028c1283d4223b8cbb2d853be42932.jpg not downloaded yet
2026-03-30 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F7b%252Fa27b2ba28a1976ce52f6f607f7117942%252Fpa%252FKE87600_d464a7b2401fef5e56fe01514190397a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_d464a7b2401fef5e56fe01514190397a.jpg not downloaded yet
2026-03-30 09:03:31 [auto1.it] INFO: Found listing with ID: BM94525
2026-03-30 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM94525%27 HTTP/1.1" 200 None
2026-03-30 09:03:31 [auto1.it] INFO: Scrape type for BM94525: 2
2026-03-30 09:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dff79d9-2353-59e5-9db7-bdb0d654a430 with identifier: BM94525
2026-03-30 09:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dff79d9-2353-59e5-9db7-bdb0d654a430 with scrape type 2
2026-03-30 09:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dff79d9-2353-59e5-9db7-bdb0d654a430 with scrape type 2
2026-03-30 09:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8dff79d9-2353-59e5-9db7-bdb0d654a430, identifier: BM94525
2026-03-30 09:03:31 [auto1.it] INFO: Found listing with ID: JL83734
2026-03-30 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL83734%27 HTTP/1.1" 200 None
2026-03-30 09:03:31 [auto1.it] INFO: Scrape type for JL83734: 2
2026-03-30 09:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e54e64-423a-5e67-b3b9-bc91a51cf864 with identifier: JL83734
2026-03-30 09:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e54e64-423a-5e67-b3b9-bc91a51cf864 with scrape type 2
2026-03-30 09:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75e54e64-423a-5e67-b3b9-bc91a51cf864 with scrape type 2
2026-03-30 09:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 75e54e64-423a-5e67-b3b9-bc91a51cf864, identifier: JL83734
2026-03-30 09:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG28581/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_259942df2803f9b99269fef72f1d3ac9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_1d4e926f59f3c397c72f9670556f3716.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8dff79d9-2353-59e5-9db7-bdb0d654a430 with identifier: BM94525
2026-03-30 09:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8dff79d9-2353-59e5-9db7-bdb0d654a430 with identifier: BM94525
2026-03-30 09:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8dff79d9-2353-59e5-9db7-bdb0d654a430 with identifier: BM94525 to the API
2026-03-30 09:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:16:56Z',
 'fuel_type': 'diesel',
 'id': '8dff79d9-2353-59e5-9db7-bdb0d654a430',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM94525',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 148471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-21',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM94525%27 HTTP/1.1" 200 None
2026-03-30 09:03:32 [auto1.it] INFO: Saving data for BM94525: {'auction_closing_time': 1774970216.0, 'created_time': 1774386107.972446, 'last_price_update_time': 1774861412.211535}
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BM94525') HTTP/1.1" 204 0
2026-03-30 09:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 75e54e64-423a-5e67-b3b9-bc91a51cf864 with identifier: JL83734
2026-03-30 09:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 75e54e64-423a-5e67-b3b9-bc91a51cf864 with identifier: JL83734
2026-03-30 09:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 75e54e64-423a-5e67-b3b9-bc91a51cf864 with identifier: JL83734 to the API
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:51:48Z',
 'fuel_type': 'diesel',
 'id': '75e54e64-423a-5e67-b3b9-bc91a51cf864',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL83734',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 98474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2018}
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL83734%27 HTTP/1.1" 200 None
2026-03-30 09:03:32 [auto1.it] INFO: Saving data for JL83734: {'auction_closing_time': 1774972308.0, 'created_time': 1773236877.481613, 'last_price_update_time': 1774861412.720654}
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JL83734') HTTP/1.1" 204 0
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_ab73f81e203e8767bec71b357d8a4d5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_ab73f81e203e8767bec71b357d8a4d5e.jpg not downloaded yet
2026-03-30 09:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_9c95b7ac82e2cb9010564f272a7f077e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_619f702a11ccdc41d2a25ab2105a4c62.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:32 [auto1.it] INFO: Found listing with ID: NC77836
2026-03-30 09:03:32 [auto1.it] INFO: Found listing with ID: TT40811
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT40811%27 HTTP/1.1" 200 None
2026-03-30 09:03:32 [auto1.it] INFO: Scrape type for TT40811: 0
2026-03-30 09:03:32 [auto1.it] INFO: Found listing with ID: SP39094
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP39094%27 HTTP/1.1" 200 None
2026-03-30 09:03:32 [auto1.it] INFO: Scrape type for SP39094: 2
2026-03-30 09:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a382956-537d-51b3-8922-8e75c79e581b with identifier: SP39094
2026-03-30 09:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a382956-537d-51b3-8922-8e75c79e581b with scrape type 2
2026-03-30 09:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a382956-537d-51b3-8922-8e75c79e581b with scrape type 2
2026-03-30 09:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1a382956-537d-51b3-8922-8e75c79e581b, identifier: SP39094
2026-03-30 09:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR25970> (referer: https://www.auto1.com/v1/car-details-view/XR25970/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1a382956-537d-51b3-8922-8e75c79e581b with identifier: SP39094
2026-03-30 09:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1a382956-537d-51b3-8922-8e75c79e581b with identifier: SP39094
2026-03-30 09:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1a382956-537d-51b3-8922-8e75c79e581b with identifier: SP39094 to the API
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-31T15:02:51Z',
 'fuel_type': 'hybrid',
 'id': '1a382956-537d-51b3-8922-8e75c79e581b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP39094',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 160787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-31',
 'seller_name': None,
 'title': 'Volvo S60 2.0 T8 Plug-in Hybrid R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2019}
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP39094%27 HTTP/1.1" 200 None
2026-03-30 09:03:33 [auto1.it] INFO: Saving data for SP39094: {'auction_closing_time': 1774969371.0, 'created_time': 1774472501.014386, 'last_price_update_time': 1774861413.30848}
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SP39094') HTTP/1.1" 204 0
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_7aa597366326095ad8b6255995342b4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_7aa597366326095ad8b6255995342b4b.jpg not downloaded yet
2026-03-30 09:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_996541d9890fa820c898059372742a89.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:33 [auto1.it] INFO: Found listing with ID: LC22701
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC22701%27 HTTP/1.1" 200 None
2026-03-30 09:03:33 [auto1.it] INFO: Scrape type for LC22701: 2
2026-03-30 09:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7be345e-f0b7-5fdf-9f69-46af340bfe0f with identifier: LC22701
2026-03-30 09:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7be345e-f0b7-5fdf-9f69-46af340bfe0f with scrape type 2
2026-03-30 09:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7be345e-f0b7-5fdf-9f69-46af340bfe0f with scrape type 2
2026-03-30 09:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e7be345e-f0b7-5fdf-9f69-46af340bfe0f, identifier: LC22701
2026-03-30 09:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_a1a3ae045d0e0b3e8ff64de44414e4a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_0a112dd9fc7e6584b40cb030df62e7d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e7be345e-f0b7-5fdf-9f69-46af340bfe0f with identifier: LC22701
2026-03-30 09:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e7be345e-f0b7-5fdf-9f69-46af340bfe0f with identifier: LC22701
2026-03-30 09:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e7be345e-f0b7-5fdf-9f69-46af340bfe0f with identifier: LC22701 to the API
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:47:20Z',
 'fuel_type': 'diesel',
 'id': 'e7be345e-f0b7-5fdf-9f69-46af340bfe0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC22701',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 270503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-10',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC22701%27 HTTP/1.1" 200 None
2026-03-30 09:03:33 [auto1.it] INFO: Saving data for LC22701: {'auction_closing_time': 1774972040.0, 'created_time': 1774361041.535321, 'last_price_update_time': 1774861413.859149}
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC22701') HTTP/1.1" 204 0
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_b2929d9f68a3f24a1d600733f52a8f02.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_b2929d9f68a3f24a1d600733f52a8f02.jpg not downloaded yet
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0613ae10>
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_259942df2803f9b99269fef72f1d3ac9.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_259942df2803f9b99269fef72f1d3ac9.jpg saved to cache
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b254d90-a747-52c8-9427-02d30dfb1c18
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0623e710>
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_1d4e926f59f3c397c72f9670556f3716.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_1d4e926f59f3c397c72f9670556f3716.jpg saved to cache
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b254d90-a747-52c8-9427-02d30dfb1c18
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d98710>
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faf4abfc-a350-5414-81ab-b445c5b6c412/faf4abfc-a350-5414-81ab-b445c5b6c412_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F7b%252Fa27b2ba28a1976ce52f6f607f7117942%252Fpa%252FKE87600_9c95b7ac82e2cb9010564f272a7f077e.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_9c95b7ac82e2cb9010564f272a7f077e.jpg saved to cache
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item faf4abfc-a350-5414-81ab-b445c5b6c412
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061c0cd0>
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faf4abfc-a350-5414-81ab-b445c5b6c412/faf4abfc-a350-5414-81ab-b445c5b6c412_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F7b%252Fa27b2ba28a1976ce52f6f607f7117942%252Fpa%252FKE87600_619f702a11ccdc41d2a25ab2105a4c62.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_619f702a11ccdc41d2a25ab2105a4c62.jpg saved to cache
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item faf4abfc-a350-5414-81ab-b445c5b6c412
2026-03-30 09:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_d464a7b2401fef5e56fe01514190397a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:34 [auto1.it] INFO: Found listing with ID: BX20642
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX20642%27 HTTP/1.1" 200 None
2026-03-30 09:03:34 [auto1.it] INFO: Scrape type for BX20642: 2
2026-03-30 09:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8421ae92-2616-5fc2-8a6f-868611521920 with identifier: BX20642
2026-03-30 09:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8421ae92-2616-5fc2-8a6f-868611521920 with scrape type 2
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8421ae92-2616-5fc2-8a6f-868611521920 with scrape type 2
2026-03-30 09:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8421ae92-2616-5fc2-8a6f-868611521920, identifier: BX20642
2026-03-30 09:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_1b028c1283d4223b8cbb2d853be42932.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8421ae92-2616-5fc2-8a6f-868611521920 with identifier: BX20642
2026-03-30 09:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8421ae92-2616-5fc2-8a6f-868611521920 with identifier: BX20642
2026-03-30 09:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8421ae92-2616-5fc2-8a6f-868611521920 with identifier: BX20642 to the API
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:26:25Z',
 'fuel_type': 'diesel',
 'id': '8421ae92-2616-5fc2-8a6f-868611521920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX20642',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 123601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-12',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 SE Dynamic',
 'transmission': 'automatic',
 'trim': 'SE Dynamic',
 'year': 2017}
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX20642%27 HTTP/1.1" 200 None
2026-03-30 09:03:34 [auto1.it] INFO: Saving data for BX20642: {'auction_closing_time': 1774970785.0, 'created_time': 1773502038.766891, 'last_price_update_time': 1774861414.884891}
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BX20642') HTTP/1.1" 204 0
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_64b09bf3ad41b36d3d31b417537b2bbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_64b09bf3ad41b36d3d31b417537b2bbb.jpg not downloaded yet
2026-03-30 09:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 915a2653-b8e1-5518-a3a7-f5cc0485b980 with identifier: XR25970
2026-03-30 09:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915a2653-b8e1-5518-a3a7-f5cc0485b980 with scrape type 1
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 915a2653-b8e1-5518-a3a7-f5cc0485b980
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a898691cfa6e282f1bf2edc094ac1d%252Fpa%252FXR25970_10923428ed5d73fd283a7eb89cc254f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_10923428ed5d73fd283a7eb89cc254f5.jpg not downloaded yet
2026-03-30 09:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0628ea10>
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_996541d9890fa820c898059372742a89.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_996541d9890fa820c898059372742a89.jpg saved to cache
2026-03-30 09:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b254d90-a747-52c8-9427-02d30dfb1c18
2026-03-30 09:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_ab73f81e203e8767bec71b357d8a4d5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_23f158cb59ed63f840d4dc349e7f6a08.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:35 [auto1.it] INFO: Found listing with ID: VZ29537
2026-03-30 09:03:35 [auto1.it] INFO: Found listing with ID: RX33676
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX33676%27 HTTP/1.1" 200 None
2026-03-30 09:03:35 [auto1.it] INFO: Scrape type for RX33676: 2
2026-03-30 09:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cecfe42e-27ef-5b2f-8bd8-566511fd2190 with identifier: RX33676
2026-03-30 09:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cecfe42e-27ef-5b2f-8bd8-566511fd2190 with scrape type 2
2026-03-30 09:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cecfe42e-27ef-5b2f-8bd8-566511fd2190 with scrape type 2
2026-03-30 09:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cecfe42e-27ef-5b2f-8bd8-566511fd2190, identifier: RX33676
2026-03-30 09:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cecfe42e-27ef-5b2f-8bd8-566511fd2190 with identifier: RX33676
2026-03-30 09:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cecfe42e-27ef-5b2f-8bd8-566511fd2190 with identifier: RX33676
2026-03-30 09:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cecfe42e-27ef-5b2f-8bd8-566511fd2190 with identifier: RX33676 to the API
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:49:02Z',
 'fuel_type': 'petrol',
 'id': 'cecfe42e-27ef-5b2f-8bd8-566511fd2190',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX33676',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 116345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-31',
 'seller_name': None,
 'title': 'Fiat 500C 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2011}
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX33676%27 HTTP/1.1" 200 None
2026-03-30 09:03:35 [auto1.it] INFO: Saving data for RX33676: {'auction_closing_time': 1774972142.0, 'created_time': 1774353763.845714, 'last_price_update_time': 1774861415.578238}
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX33676') HTTP/1.1" 204 0
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_5a8eb63fe951bd4fde5e1a7d03d13004.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_5a8eb63fe951bd4fde5e1a7d03d13004.jpg not downloaded yet
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a898691cfa6e282f1bf2edc094ac1d%252Fpa%252FXR25970_9b7c30ec9b85069a80a19287d8df95ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_9b7c30ec9b85069a80a19287d8df95ec.jpg not downloaded yet
2026-03-30 09:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_62c93984919ef2ea34d13229ae9f1ee3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:35 [auto1.it] INFO: Found listing with ID: AX27463
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX27463%27 HTTP/1.1" 200 None
2026-03-30 09:03:35 [auto1.it] INFO: Scrape type for AX27463: 2
2026-03-30 09:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d11c486-3efe-59d2-9235-b8e410cc7aca with identifier: AX27463
2026-03-30 09:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d11c486-3efe-59d2-9235-b8e410cc7aca with scrape type 2
2026-03-30 09:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d11c486-3efe-59d2-9235-b8e410cc7aca with scrape type 2
2026-03-30 09:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d11c486-3efe-59d2-9235-b8e410cc7aca, identifier: AX27463
2026-03-30 09:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW20152> (referer: https://www.auto1.com/v1/car-details-view/GW20152/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH15669> (referer: https://www.auto1.com/v1/car-details-view/JH15669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d06fdd0>
2026-03-30 09:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_a1a3ae045d0e0b3e8ff64de44414e4a3.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_a1a3ae045d0e0b3e8ff64de44414e4a3.jpg saved to cache
2026-03-30 09:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f
2026-03-30 09:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd2b90>
2026-03-30 09:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faf4abfc-a350-5414-81ab-b445c5b6c412/faf4abfc-a350-5414-81ab-b445c5b6c412_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F7b%252Fa27b2ba28a1976ce52f6f607f7117942%252Fpa%252FKE87600_0a112dd9fc7e6584b40cb030df62e7d0.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_0a112dd9fc7e6584b40cb030df62e7d0.jpg saved to cache
2026-03-30 09:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item faf4abfc-a350-5414-81ab-b445c5b6c412
2026-03-30 09:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0624b550>
2026-03-30 09:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faf4abfc-a350-5414-81ab-b445c5b6c412/faf4abfc-a350-5414-81ab-b445c5b6c412_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F7b%252Fa27b2ba28a1976ce52f6f607f7117942%252Fpa%252FKE87600_d464a7b2401fef5e56fe01514190397a.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_d464a7b2401fef5e56fe01514190397a.jpg saved to cache
2026-03-30 09:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item faf4abfc-a350-5414-81ab-b445c5b6c412
2026-03-30 09:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061a7dd0>
2026-03-30 09:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_1b028c1283d4223b8cbb2d853be42932.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_1b028c1283d4223b8cbb2d853be42932.jpg saved to cache
2026-03-30 09:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b254d90-a747-52c8-9427-02d30dfb1c18
2026-03-30 09:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_7aa597366326095ad8b6255995342b4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d11c486-3efe-59d2-9235-b8e410cc7aca with identifier: AX27463
2026-03-30 09:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d11c486-3efe-59d2-9235-b8e410cc7aca with identifier: AX27463
2026-03-30 09:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d11c486-3efe-59d2-9235-b8e410cc7aca with identifier: AX27463 to the API
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:44:37Z',
 'fuel_type': 'diesel',
 'id': '9d11c486-3efe-59d2-9235-b8e410cc7aca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX27463',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 124375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX27463%27 HTTP/1.1" 200 None
2026-03-30 09:03:36 [auto1.it] INFO: Saving data for AX27463: {'auction_closing_time': 1774971877.0, 'created_time': 1773997441.751803, 'last_price_update_time': 1774861416.420713}
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AX27463') HTTP/1.1" 204 0
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a898691cfa6e282f1bf2edc094ac1d%252Fpa%252FXR25970_74986774c38f85522d5cfa4f9db80905.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_74986774c38f85522d5cfa4f9db80905.jpg not downloaded yet
2026-03-30 09:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_3c53a69caef259c7ea492f65363e7b42.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:36 [auto1.it] INFO: Found listing with ID: CD12449
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD12449%27 HTTP/1.1" 200 None
2026-03-30 09:03:36 [auto1.it] INFO: Scrape type for CD12449: 2
2026-03-30 09:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1724c691-a289-5236-bcbd-482833ed1fe9 with identifier: CD12449
2026-03-30 09:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1724c691-a289-5236-bcbd-482833ed1fe9 with scrape type 2
2026-03-30 09:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1724c691-a289-5236-bcbd-482833ed1fe9 with scrape type 2
2026-03-30 09:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1724c691-a289-5236-bcbd-482833ed1fe9, identifier: CD12449
2026-03-30 09:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_b2929d9f68a3f24a1d600733f52a8f02.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1724c691-a289-5236-bcbd-482833ed1fe9 with identifier: CD12449
2026-03-30 09:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1724c691-a289-5236-bcbd-482833ed1fe9 with identifier: CD12449
2026-03-30 09:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1724c691-a289-5236-bcbd-482833ed1fe9 with identifier: CD12449 to the API
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-31T15:09:01Z',
 'fuel_type': 'petrol',
 'id': '1724c691-a289-5236-bcbd-482833ed1fe9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD12449',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 5137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-24',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 DualJet Mild-Hybrid Top',
 'transmission': 'manual',
 'trim': 'Top',
 'year': 2024}
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD12449%27 HTTP/1.1" 200 None
2026-03-30 09:03:36 [auto1.it] INFO: Saving data for CD12449: {'auction_closing_time': 1774969741.0, 'created_time': 1774353893.110176, 'last_price_update_time': 1774861416.956359}
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CD12449') HTTP/1.1" 204 0
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a898691cfa6e282f1bf2edc094ac1d%252Fpa%252FXR25970_ebce7aa1f6a5367f54f3a302d93f799b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_ebce7aa1f6a5367f54f3a302d93f799b.jpg not downloaded yet
2026-03-30 09:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0623fdd0>
2026-03-30 09:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_ab73f81e203e8767bec71b357d8a4d5e.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_ab73f81e203e8767bec71b357d8a4d5e.jpg saved to cache
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b254d90-a747-52c8-9427-02d30dfb1c18
2026-03-30 09:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06243410>
2026-03-30 09:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faf4abfc-a350-5414-81ab-b445c5b6c412/faf4abfc-a350-5414-81ab-b445c5b6c412_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F7b%252Fa27b2ba28a1976ce52f6f607f7117942%252Fpa%252FKE87600_23f158cb59ed63f840d4dc349e7f6a08.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_23f158cb59ed63f840d4dc349e7f6a08.jpg saved to cache
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item faf4abfc-a350-5414-81ab-b445c5b6c412
2026-03-30 09:03:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: faf4abfc-a350-5414-81ab-b445c5b6c412, skipping ID generation
2026-03-30 09:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf4abfc-a350-5414-81ab-b445c5b6c412 with scrape type 1
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item faf4abfc-a350-5414-81ab-b445c5b6c412 sending to next pipeline
2026-03-30 09:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: faf4abfc-a350-5414-81ab-b445c5b6c412, identifier: KE87600
2026-03-30 09:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06390890>
2026-03-30 09:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_62c93984919ef2ea34d13229ae9f1ee3.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_62c93984919ef2ea34d13229ae9f1ee3.jpg saved to cache
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b254d90-a747-52c8-9427-02d30dfb1c18
2026-03-30 09:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a09fef4-293c-58e9-a9a3-caec9861a249 with identifier: GW20152
2026-03-30 09:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a09fef4-293c-58e9-a9a3-caec9861a249 with scrape type 1
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a09fef4-293c-58e9-a9a3-caec9861a249
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_d05a7d052003ce42d863eb7862b44c4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_d05a7d052003ce42d863eb7862b44c4f.jpg not downloaded yet
2026-03-30 09:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 149baf17-4de5-52d0-ba17-62ef2c34e85a with identifier: JH15669
2026-03-30 09:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 149baf17-4de5-52d0-ba17-62ef2c34e85a with scrape type 1
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 149baf17-4de5-52d0-ba17-62ef2c34e85a
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F03%252F6e03889c597c160706231423041e906f%252Fpa%252FJH15669_b879e73e8e352c6bc679ab774c175bfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_b879e73e8e352c6bc679ab774c175bfd.jpg already downloaded
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F03%252F6e03889c597c160706231423041e906f%252Fpa%252FJH15669_f9657b738b7075125271c0c53f0e207c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_f9657b738b7075125271c0c53f0e207c.jpg already downloaded
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F03%252F6e03889c597c160706231423041e906f%252Fpa%252FJH15669_02687e9b1f87bdd1ce3159b46f1e8ebe.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_02687e9b1f87bdd1ce3159b46f1e8ebe.jpg already downloaded
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F03%252F6e03889c597c160706231423041e906f%252Fpa%252FJH15669_85131ec2741086f06464a4f908a59a9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_85131ec2741086f06464a4f908a59a9b.jpg already downloaded
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F03%252F6e03889c597c160706231423041e906f%252Fpa%252FJH15669_ef2df2b4ac0c1cbadb6aa3e3dd7788b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_ef2df2b4ac0c1cbadb6aa3e3dd7788b5.jpg already downloaded
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F03%252F6e03889c597c160706231423041e906f%252Fpa%252FJH15669_654834cb471e6913461ed22cd6e56d29.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_654834cb471e6913461ed22cd6e56d29.jpg already downloaded
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F03%252F6e03889c597c160706231423041e906f%252Fpa%252FJH15669_61ceb2a6c2c0b9e49be2432f4574662a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_61ceb2a6c2c0b9e49be2432f4574662a.jpg already downloaded
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F03%252F6e03889c597c160706231423041e906f%252Fpa%252FJH15669_c2df45def8fd4f75d1333fa401d87adf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_c2df45def8fd4f75d1333fa401d87adf.jpg already downloaded
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F03%252F6e03889c597c160706231423041e906f%252Fpa%252FJH15669_859d22fec94455a7cc8b53fff39c77c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_859d22fec94455a7cc8b53fff39c77c6.jpg already downloaded
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F03%252F6e03889c597c160706231423041e906f%252Fpa%252FJH15669_0425aa3a121b31c8b2951125a553cd87.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_0425aa3a121b31c8b2951125a553cd87.jpg already downloaded
2026-03-30 09:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 149baf17-4de5-52d0-ba17-62ef2c34e85a, identifier: JH15669
2026-03-30 09:03:37 [auto1.it] INFO: Found listing with ID: JZ26894
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ26894%27 HTTP/1.1" 200 None
2026-03-30 09:03:37 [auto1.it] INFO: Scrape type for JZ26894: 2
2026-03-30 09:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d24fa44-f0d3-5cf5-a4dc-a09057646358 with identifier: JZ26894
2026-03-30 09:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d24fa44-f0d3-5cf5-a4dc-a09057646358 with scrape type 2
2026-03-30 09:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d24fa44-f0d3-5cf5-a4dc-a09057646358 with scrape type 2
2026-03-30 09:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1d24fa44-f0d3-5cf5-a4dc-a09057646358, identifier: JZ26894
2026-03-30 09:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: faf4abfc-a350-5414-81ab-b445c5b6c412 with identifier: KE87600
2026-03-30 09:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: faf4abfc-a350-5414-81ab-b445c5b6c412 with identifier: KE87600
2026-03-30 09:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: faf4abfc-a350-5414-81ab-b445c5b6c412 with identifier: KE87600 to the API
2026-03-30 09:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_23f158cb59ed63f840d4dc349e7f6a08.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:41:50Z',
 'fuel_type': 'petrol',
 'id': 'faf4abfc-a350-5414-81ab-b445c5b6c412',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE87600',
 'listing': 'auction',
 'location': 'IT, Gaglianico BI',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 195876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faf4abfc-a350-5414-81ab-b445c5b6c412/faf4abfc-a350-5414-81ab-b445c5b6c412_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_0a112dd9fc7e6584b40cb030df62e7d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faf4abfc-a350-5414-81ab-b445c5b6c412/faf4abfc-a350-5414-81ab-b445c5b6c412_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_9c95b7ac82e2cb9010564f272a7f077e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faf4abfc-a350-5414-81ab-b445c5b6c412/faf4abfc-a350-5414-81ab-b445c5b6c412_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_619f702a11ccdc41d2a25ab2105a4c62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faf4abfc-a350-5414-81ab-b445c5b6c412/faf4abfc-a350-5414-81ab-b445c5b6c412_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_23f158cb59ed63f840d4dc349e7f6a08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faf4abfc-a350-5414-81ab-b445c5b6c412/faf4abfc-a350-5414-81ab-b445c5b6c412_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/7b/a27b2ba28a1976ce52f6f607f7117942/pa/KE87600_d464a7b2401fef5e56fe01514190397a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE87600%27 HTTP/1.1" 200 None
2026-03-30 09:03:38 [auto1.it] INFO: Saving data for KE87600: {'created_time': 1774861418.135809, 'last_price_update_time': 1774861418.13582, 'auction_closing_time': 1774971710.0}
2026-03-30 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KE87600') HTTP/1.1" 204 0
2026-03-30 09:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 149baf17-4de5-52d0-ba17-62ef2c34e85a with identifier: JH15669
2026-03-30 09:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 149baf17-4de5-52d0-ba17-62ef2c34e85a with identifier: JH15669
2026-03-30 09:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 149baf17-4de5-52d0-ba17-62ef2c34e85a with identifier: JH15669 to the API
2026-03-30 09:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JH15669>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:02:38Z',
 'fuel_type': 'diesel',
 'id': '149baf17-4de5-52d0-ba17-62ef2c34e85a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH15669',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 111231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_b879e73e8e352c6bc679ab774c175bfd.jpg',
                'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_f9657b738b7075125271c0c53f0e207c.jpg',
                'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_02687e9b1f87bdd1ce3159b46f1e8ebe.jpg',
                'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_85131ec2741086f06464a4f908a59a9b.jpg',
                'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_ef2df2b4ac0c1cbadb6aa3e3dd7788b5.jpg',
                'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_654834cb471e6913461ed22cd6e56d29.jpg',
                'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_61ceb2a6c2c0b9e49be2432f4574662a.jpg',
                'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_c2df45def8fd4f75d1333fa401d87adf.jpg',
                'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_859d22fec94455a7cc8b53fff39c77c6.jpg',
                'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_0425aa3a121b31c8b2951125a553cd87.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_149baf17-4de5-52d0-ba17-62ef2c34e85a/149baf17-4de5-52d0-ba17-62ef2c34e85a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3034877,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_b879e73e8e352c6bc679ab774c175bfd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_149baf17-4de5-52d0-ba17-62ef2c34e85a/149baf17-4de5-52d0-ba17-62ef2c34e85a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3075752,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_f9657b738b7075125271c0c53f0e207c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_149baf17-4de5-52d0-ba17-62ef2c34e85a/149baf17-4de5-52d0-ba17-62ef2c34e85a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_02687e9b1f87bdd1ce3159b46f1e8ebe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_149baf17-4de5-52d0-ba17-62ef2c34e85a/149baf17-4de5-52d0-ba17-62ef2c34e85a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_85131ec2741086f06464a4f908a59a9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_149baf17-4de5-52d0-ba17-62ef2c34e85a/149baf17-4de5-52d0-ba17-62ef2c34e85a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_ef2df2b4ac0c1cbadb6aa3e3dd7788b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_149baf17-4de5-52d0-ba17-62ef2c34e85a/149baf17-4de5-52d0-ba17-62ef2c34e85a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3035856,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_654834cb471e6913461ed22cd6e56d29.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_149baf17-4de5-52d0-ba17-62ef2c34e85a/149baf17-4de5-52d0-ba17-62ef2c34e85a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_61ceb2a6c2c0b9e49be2432f4574662a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_149baf17-4de5-52d0-ba17-62ef2c34e85a/149baf17-4de5-52d0-ba17-62ef2c34e85a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_c2df45def8fd4f75d1333fa401d87adf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_149baf17-4de5-52d0-ba17-62ef2c34e85a/149baf17-4de5-52d0-ba17-62ef2c34e85a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2945438,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_859d22fec94455a7cc8b53fff39c77c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_149baf17-4de5-52d0-ba17-62ef2c34e85a/149baf17-4de5-52d0-ba17-62ef2c34e85a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3154260,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/03/6e03889c597c160706231423041e906f/pa/JH15669_0425aa3a121b31c8b2951125a553cd87.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.1 CRDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH15669%27 HTTP/1.1" 200 None
2026-03-30 09:03:39 [auto1.it] INFO: Saving data for JH15669: {'created_time': 1774861419.238402, 'last_price_update_time': 1774861419.238414, 'auction_closing_time': 1774969358.0}
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JH15669') HTTP/1.1" 204 0
2026-03-30 09:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_6b94f5b015dd995ad556dfb6cc355829.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1d24fa44-f0d3-5cf5-a4dc-a09057646358 with identifier: JZ26894
2026-03-30 09:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1d24fa44-f0d3-5cf5-a4dc-a09057646358 with identifier: JZ26894
2026-03-30 09:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1d24fa44-f0d3-5cf5-a4dc-a09057646358 with identifier: JZ26894 to the API
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:44:18Z',
 'fuel_type': 'diesel',
 'id': '1d24fa44-f0d3-5cf5-a4dc-a09057646358',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ26894',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 154495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Business AWD',
 'transmission': 'automatic',
 'trim': 'Business AWD',
 'year': 2019}
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ26894%27 HTTP/1.1" 200 None
2026-03-30 09:03:39 [auto1.it] INFO: Saving data for JZ26894: {'auction_closing_time': 1774971858.0, 'created_time': 1773824527.240394, 'last_price_update_time': 1774861419.553299}
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ26894') HTTP/1.1" 204 0
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a898691cfa6e282f1bf2edc094ac1d%252Fpa%252FXR25970_63bfd0520f43b96eae19ba5571c804f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_63bfd0520f43b96eae19ba5571c804f6.jpg not downloaded yet
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_51899ec672d5a71fab9b0865612f5eac.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_51899ec672d5a71fab9b0865612f5eac.jpg not downloaded yet
2026-03-30 09:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_7d8ea891df8e2f16acc4551d27490640.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:39 [auto1.it] INFO: Found listing with ID: MB91559
2026-03-30 09:03:39 [auto1.it] INFO: Found listing with ID: WT68186
2026-03-30 09:03:39 [auto1.it] INFO: Found listing with ID: ZB83520
2026-03-30 09:03:39 [auto1.it] INFO: Found listing with ID: JR03068
2026-03-30 09:03:39 [auto1.it] INFO: Found listing with ID: UN95232
2026-03-30 09:03:39 [auto1.it] INFO: Found listing with ID: LY05485
2026-03-30 09:03:39 [auto1.it] INFO: Found listing with ID: PF40120
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF40120%27 HTTP/1.1" 200 None
2026-03-30 09:03:39 [auto1.it] INFO: Scrape type for PF40120: 2
2026-03-30 09:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f4b354-7b2c-54d2-a9d6-a14ea493d56b with identifier: PF40120
2026-03-30 09:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f4b354-7b2c-54d2-a9d6-a14ea493d56b with scrape type 2
2026-03-30 09:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17f4b354-7b2c-54d2-a9d6-a14ea493d56b with scrape type 2
2026-03-30 09:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 17f4b354-7b2c-54d2-a9d6-a14ea493d56b, identifier: PF40120
2026-03-30 09:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d84b10>
2026-03-30 09:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_7aa597366326095ad8b6255995342b4b.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_7aa597366326095ad8b6255995342b4b.jpg saved to cache
2026-03-30 09:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b254d90-a747-52c8-9427-02d30dfb1c18
2026-03-30 09:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ccbbd0>
2026-03-30 09:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F90%252Fd490a0215f74f50ccb394aa9a41a84a0%252Fpa%252FVU13250_3c53a69caef259c7ea492f65363e7b42.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_3c53a69caef259c7ea492f65363e7b42.jpg saved to cache
2026-03-30 09:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b767cebb-7d47-58e7-bed7-591a8c61d7d3
2026-03-30 09:03:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b767cebb-7d47-58e7-bed7-591a8c61d7d3, skipping ID generation
2026-03-30 09:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b767cebb-7d47-58e7-bed7-591a8c61d7d3 with scrape type 1
2026-03-30 09:03:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b767cebb-7d47-58e7-bed7-591a8c61d7d3 sending to next pipeline
2026-03-30 09:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b767cebb-7d47-58e7-bed7-591a8c61d7d3, identifier: VU13250
2026-03-30 09:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f5ce10>
2026-03-30 09:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_b2929d9f68a3f24a1d600733f52a8f02.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_b2929d9f68a3f24a1d600733f52a8f02.jpg saved to cache
2026-03-30 09:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b254d90-a747-52c8-9427-02d30dfb1c18
2026-03-30 09:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_10923428ed5d73fd283a7eb89cc254f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 17f4b354-7b2c-54d2-a9d6-a14ea493d56b with identifier: PF40120
2026-03-30 09:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 17f4b354-7b2c-54d2-a9d6-a14ea493d56b with identifier: PF40120
2026-03-30 09:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 17f4b354-7b2c-54d2-a9d6-a14ea493d56b with identifier: PF40120 to the API
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:27:34Z',
 'fuel_type': 'diesel',
 'id': '17f4b354-7b2c-54d2-a9d6-a14ea493d56b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF40120',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 207203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-02',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF40120%27 HTTP/1.1" 200 None
2026-03-30 09:03:40 [auto1.it] INFO: Saving data for PF40120: {'auction_closing_time': 1774970854.0, 'created_time': 1774440049.756878, 'last_price_update_time': 1774861420.417257}
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PF40120') HTTP/1.1" 204 0
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_4efb232a64198da00ec7fc3d839dadf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_4efb232a64198da00ec7fc3d839dadf3.jpg not downloaded yet
2026-03-30 09:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b767cebb-7d47-58e7-bed7-591a8c61d7d3 with identifier: VU13250
2026-03-30 09:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b767cebb-7d47-58e7-bed7-591a8c61d7d3 with identifier: VU13250
2026-03-30 09:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b767cebb-7d47-58e7-bed7-591a8c61d7d3 with identifier: VU13250 to the API
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_3c53a69caef259c7ea492f65363e7b42.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:00:05Z',
 'fuel_type': 'diesel',
 'id': 'b767cebb-7d47-58e7-bed7-591a8c61d7d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU13250',
 'listing': 'auction',
 'location': 'IT, Frosinone',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 161240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_e8b5584a90a002aa86191091a9b7d949.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_f23409d5b70a59199bd9baf760cae375.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_a190697f2f90e999fc9742c14e368a31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_fbc3dd555a610142dc5f2a548b042f2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_3c53a69caef259c7ea492f65363e7b42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_64f55137b91e2b7bb43e55720b73d250.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_bffbc21b52d1c86f4d074e90a476c6cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_7e2ac68db0ed1e79834d078e6000147b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_bae66a4de7db4b88e429a7e5f3a0f9a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b767cebb-7d47-58e7-bed7-591a8c61d7d3/b767cebb-7d47-58e7-bed7-591a8c61d7d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/90/d490a0215f74f50ccb394aa9a41a84a0/pa/VU13250_bb616d0ab612cc63d29eda36fa6c3751.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2017}
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU13250%27 HTTP/1.1" 200 None
2026-03-30 09:03:40 [auto1.it] INFO: Saving data for VU13250: {'created_time': 1774861420.937728, 'last_price_update_time': 1774861420.937739, 'auction_closing_time': 1774969205.0}
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VU13250') HTTP/1.1" 204 0
2026-03-30 09:03:40 [auto1.it] INFO: Found listing with ID: PV06948
2026-03-30 09:03:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d49d10>
2026-03-30 09:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F93%252F67936ae5bbb17cb20c4b613e14f56250%252Fpa%252FDK43597_6b94f5b015dd995ad556dfb6cc355829.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_6b94f5b015dd995ad556dfb6cc355829.jpg saved to cache
2026-03-30 09:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f
2026-03-30 09:03:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f, skipping ID generation
2026-03-30 09:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f with scrape type 1
2026-03-30 09:03:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f sending to next pipeline
2026-03-30 09:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f, identifier: DK43597
2026-03-30 09:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_5a8eb63fe951bd4fde5e1a7d03d13004.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_74f24b6e557fca67e7fb8083182f10ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_74f24b6e557fca67e7fb8083182f10ae.jpg not downloaded yet
2026-03-30 09:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f with identifier: DK43597
2026-03-30 09:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f with identifier: DK43597
2026-03-30 09:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f with identifier: DK43597 to the API
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_6b94f5b015dd995ad556dfb6cc355829.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:19:58Z',
 'fuel_type': 'diesel',
 'id': 'bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK43597',
 'listing': 'auction',
 'location': 'IT, Asti',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 120156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2227446,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_6b94f5b015dd995ad556dfb6cc355829.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_a90aaa85c4e1b3020e98ca761b302a57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_5c3c54c24d86bdb912fcbba2e069f238.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_2f91e07b08c04665352b860c079027eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2137690,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_a1a3ae045d0e0b3e8ff64de44414e4a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_bdf5e57aa88a81c72f1c77a10e579a3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_5cd1a62368f4f06cbb591f977606f3d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_1e03926795c0673053c1bcf1bca794b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_8daae6e54c4938bc7ae4a0e03d62a20d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f/bbe9ca94-4b0c-5be7-aabe-9c9dc0f7fc9f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/93/67936ae5bbb17cb20c4b613e14f56250/pa/DK43597_7fbd9a531bcfa60e29cadfb522ca24ef.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 1.5 Diesel Exceed',
 'transmission': 'manual',
 'trim': 'Exceed',
 'year': 2016}
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK43597%27 HTTP/1.1" 200 None
2026-03-30 09:03:41 [auto1.it] INFO: Saving data for DK43597: {'created_time': 1774861421.683201, 'last_price_update_time': 1774861421.683212, 'auction_closing_time': 1774970398.0}
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DK43597') HTTP/1.1" 204 0
2026-03-30 09:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0622cf90>
2026-03-30 09:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_7d8ea891df8e2f16acc4551d27490640.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_7d8ea891df8e2f16acc4551d27490640.jpg saved to cache
2026-03-30 09:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea036585-d06d-57db-92c9-a238b1e2a9ac
2026-03-30 09:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_9b7c30ec9b85069a80a19287d8df95ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN24411> (referer: https://www.auto1.com/v1/car-details-view/PN24411/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062b9010>
2026-03-30 09:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915a2653-b8e1-5518-a3a7-f5cc0485b980/915a2653-b8e1-5518-a3a7-f5cc0485b980_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a898691cfa6e282f1bf2edc094ac1d%252Fpa%252FXR25970_10923428ed5d73fd283a7eb89cc254f5.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_10923428ed5d73fd283a7eb89cc254f5.jpg saved to cache
2026-03-30 09:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 915a2653-b8e1-5518-a3a7-f5cc0485b980
2026-03-30 09:03:41 [auto1.it] INFO: Channel: 24h | Page: 15 | totalHits: 3296 | hits on page: 40
2026-03-30 09:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_64b09bf3ad41b36d3d31b417537b2bbb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_68107d7e1548e3d7b332a977144a439b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_68107d7e1548e3d7b332a977144a439b.jpg not downloaded yet
2026-03-30 09:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG28581> (referer: https://www.auto1.com/v1/car-details-view/WG28581/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:41 [auto1.it] INFO: Found listing with ID: PV06948
2026-03-30 09:03:41 [auto1.it] INFO: Found listing with ID: LS46243
2026-03-30 09:03:41 [auto1.it] INFO: Found listing with ID: WV48837
2026-03-30 09:03:41 [auto1.it] INFO: Found listing with ID: DC26053
2026-03-30 09:03:41 [auto1.it] INFO: Found listing with ID: VP93910
2026-03-30 09:03:41 [auto1.it] INFO: Found listing with ID: JZ95441
2026-03-30 09:03:41 [auto1.it] INFO: Found listing with ID: DR82900
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR82900%27 HTTP/1.1" 200 None
2026-03-30 09:03:41 [auto1.it] INFO: Scrape type for DR82900: 2
2026-03-30 09:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db96e513-c20d-501a-8b40-5ae9c9e228b8 with identifier: DR82900
2026-03-30 09:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db96e513-c20d-501a-8b40-5ae9c9e228b8 with scrape type 2
2026-03-30 09:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db96e513-c20d-501a-8b40-5ae9c9e228b8 with scrape type 2
2026-03-30 09:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: db96e513-c20d-501a-8b40-5ae9c9e228b8, identifier: DR82900
2026-03-30 09:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0cd9add0>
2026-03-30 09:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_5a8eb63fe951bd4fde5e1a7d03d13004.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_5a8eb63fe951bd4fde5e1a7d03d13004.jpg saved to cache
2026-03-30 09:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b254d90-a747-52c8-9427-02d30dfb1c18
2026-03-30 09:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_74986774c38f85522d5cfa4f9db80905.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_eb91fbc582bf55583e67796c2a625dce.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_eb91fbc582bf55583e67796c2a625dce.jpg not downloaded yet
2026-03-30 09:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: db96e513-c20d-501a-8b40-5ae9c9e228b8 with identifier: DR82900
2026-03-30 09:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: db96e513-c20d-501a-8b40-5ae9c9e228b8 with identifier: DR82900
2026-03-30 09:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: db96e513-c20d-501a-8b40-5ae9c9e228b8 with identifier: DR82900 to the API
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 201,
 'expiration_date': '2026-03-31T15:10:38Z',
 'fuel_type': 'diesel',
 'id': 'db96e513-c20d-501a-8b40-5ae9c9e228b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR82900',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 166287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-27',
 'seller_name': None,
 'title': 'BMW 5er 520d Mild-Hybrid xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2020}
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR82900%27 HTTP/1.1" 200 None
2026-03-30 09:03:42 [auto1.it] INFO: Saving data for DR82900: {'auction_closing_time': 1774969838.0, 'created_time': 1774386428.535618, 'last_price_update_time': 1774861422.465805}
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DR82900') HTTP/1.1" 204 0
2026-03-30 09:03:42 [auto1.it] INFO: Found listing with ID: WH56731
2026-03-30 09:03:42 [auto1.it] INFO: Found listing with ID: FN72071
2026-03-30 09:03:42 [auto1.it] INFO: Found listing with ID: YN65512
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN65512%27 HTTP/1.1" 200 None
2026-03-30 09:03:42 [auto1.it] INFO: Scrape type for YN65512: 2
2026-03-30 09:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f83f27a5-6086-5946-9606-09ba7f3cc3a0 with identifier: YN65512
2026-03-30 09:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f83f27a5-6086-5946-9606-09ba7f3cc3a0 with scrape type 2
2026-03-30 09:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f83f27a5-6086-5946-9606-09ba7f3cc3a0 with scrape type 2
2026-03-30 09:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f83f27a5-6086-5946-9606-09ba7f3cc3a0, identifier: YN65512
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_cb02e9e41e7a8cc772fa9c703ada6662.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_cb02e9e41e7a8cc772fa9c703ada6662.jpg not downloaded yet
2026-03-30 09:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f83f27a5-6086-5946-9606-09ba7f3cc3a0 with identifier: YN65512
2026-03-30 09:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f83f27a5-6086-5946-9606-09ba7f3cc3a0 with identifier: YN65512
2026-03-30 09:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f83f27a5-6086-5946-9606-09ba7f3cc3a0 with identifier: YN65512 to the API
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:59:13Z',
 'fuel_type': 'petrol',
 'id': 'f83f27a5-6086-5946-9606-09ba7f3cc3a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN65512',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 20797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-31',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2023}
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN65512%27 HTTP/1.1" 200 None
2026-03-30 09:03:42 [auto1.it] INFO: Saving data for YN65512: {'auction_closing_time': 1774972753.0, 'created_time': 1774040729.617628, 'last_price_update_time': 1774861422.999562}
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YN65512') HTTP/1.1" 204 0
2026-03-30 09:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c33510>
2026-03-30 09:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915a2653-b8e1-5518-a3a7-f5cc0485b980/915a2653-b8e1-5518-a3a7-f5cc0485b980_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a898691cfa6e282f1bf2edc094ac1d%252Fpa%252FXR25970_9b7c30ec9b85069a80a19287d8df95ec.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_9b7c30ec9b85069a80a19287d8df95ec.jpg saved to cache
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 915a2653-b8e1-5518-a3a7-f5cc0485b980
2026-03-30 09:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae697335-c958-5640-a518-79ef8caeeb3e with identifier: PN24411
2026-03-30 09:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae697335-c958-5640-a518-79ef8caeeb3e with scrape type 1
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ae697335-c958-5640-a518-79ef8caeeb3e
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa1%252Fada1f4a89f11059afd8f8668970896c6%252Fpa%252FPN24411_17d6be8d03b1346c3422e57510a1d26e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_17d6be8d03b1346c3422e57510a1d26e.jpg not downloaded yet
2026-03-30 09:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06396310>
2026-03-30 09:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a927299fc78224c6edf4ce58d4e9497%252Fpa%252FAH42786_64b09bf3ad41b36d3d31b417537b2bbb.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_64b09bf3ad41b36d3d31b417537b2bbb.jpg saved to cache
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b254d90-a747-52c8-9427-02d30dfb1c18
2026-03-30 09:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b254d90-a747-52c8-9427-02d30dfb1c18, skipping ID generation
2026-03-30 09:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b254d90-a747-52c8-9427-02d30dfb1c18 with scrape type 1
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b254d90-a747-52c8-9427-02d30dfb1c18 sending to next pipeline
2026-03-30 09:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b254d90-a747-52c8-9427-02d30dfb1c18, identifier: AH42786
2026-03-30 09:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1bf32c-02f1-534e-ab85-18a8d6515c65 with identifier: WG28581
2026-03-30 09:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1bf32c-02f1-534e-ab85-18a8d6515c65 with scrape type 1
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc1bf32c-02f1-534e-ab85-18a8d6515c65
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fac%252Fb1ac00ce95d3da8518a1807aef957fcc%252Fpa%252FWG28581_ed8bc6272b2821b291ab76a247939011.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_ed8bc6272b2821b291ab76a247939011.jpg already downloaded
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fac%252Fb1ac00ce95d3da8518a1807aef957fcc%252Fpa%252FWG28581_bf6e0327d3fbc15d4556d7c951531fcb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_bf6e0327d3fbc15d4556d7c951531fcb.jpg already downloaded
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fac%252Fb1ac00ce95d3da8518a1807aef957fcc%252Fpa%252FWG28581_86d180eee7b3f334a4197302effe7b03.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_86d180eee7b3f334a4197302effe7b03.jpg already downloaded
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fac%252Fb1ac00ce95d3da8518a1807aef957fcc%252Fpa%252FWG28581_3adccb90af70d20e51922888ee6e36e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_3adccb90af70d20e51922888ee6e36e5.jpg already downloaded
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fac%252Fb1ac00ce95d3da8518a1807aef957fcc%252Fpa%252FWG28581_f9164fc43f0ccf16b72aa3780d10e926.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_f9164fc43f0ccf16b72aa3780d10e926.jpg already downloaded
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fac%252Fb1ac00ce95d3da8518a1807aef957fcc%252Fpa%252FWG28581_481fc9666df9ab1459d5d6a91771d0e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_481fc9666df9ab1459d5d6a91771d0e9.jpg already downloaded
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fac%252Fb1ac00ce95d3da8518a1807aef957fcc%252Fpa%252FWG28581_08bee44823f8cacc3c3b18878bbab9c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_08bee44823f8cacc3c3b18878bbab9c4.jpg already downloaded
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fac%252Fb1ac00ce95d3da8518a1807aef957fcc%252Fpa%252FWG28581_deb8d83ba36ec122baede1a8097e19b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_deb8d83ba36ec122baede1a8097e19b7.jpg already downloaded
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fac%252Fb1ac00ce95d3da8518a1807aef957fcc%252Fpa%252FWG28581_751e384027f51377602b6471abb4622f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_751e384027f51377602b6471abb4622f.jpg already downloaded
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fac%252Fb1ac00ce95d3da8518a1807aef957fcc%252Fpa%252FWG28581_22f50cfde7d2bdc9bcaccbd3b43ae048.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_22f50cfde7d2bdc9bcaccbd3b43ae048.jpg already downloaded
2026-03-30 09:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dc1bf32c-02f1-534e-ab85-18a8d6515c65, identifier: WG28581
2026-03-30 09:03:43 [auto1.it] INFO: Found listing with ID: PB31965
2026-03-30 09:03:43 [auto1.it] INFO: Found listing with ID: MB79295
2026-03-30 09:03:43 [auto1.it] INFO: Found listing with ID: MD54154
2026-03-30 09:03:43 [auto1.it] INFO: Found listing with ID: DD76151
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD76151%27 HTTP/1.1" 200 None
2026-03-30 09:03:43 [auto1.it] INFO: Scrape type for DD76151: 2
2026-03-30 09:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82e9071e-a7b7-5689-8fa1-5a449fc96fe2 with identifier: DD76151
2026-03-30 09:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82e9071e-a7b7-5689-8fa1-5a449fc96fe2 with scrape type 2
2026-03-30 09:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82e9071e-a7b7-5689-8fa1-5a449fc96fe2 with scrape type 2
2026-03-30 09:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82e9071e-a7b7-5689-8fa1-5a449fc96fe2, identifier: DD76151
2026-03-30 09:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b254d90-a747-52c8-9427-02d30dfb1c18 with identifier: AH42786
2026-03-30 09:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b254d90-a747-52c8-9427-02d30dfb1c18 with identifier: AH42786
2026-03-30 09:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b254d90-a747-52c8-9427-02d30dfb1c18 with identifier: AH42786 to the API
2026-03-30 09:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_64b09bf3ad41b36d3d31b417537b2bbb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:41:53Z',
 'fuel_type': 'diesel',
 'id': '3b254d90-a747-52c8-9427-02d30dfb1c18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH42786',
 'listing': 'auction',
 'location': 'IT, Brescia',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 216153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_996541d9890fa820c898059372742a89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_259942df2803f9b99269fef72f1d3ac9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_1d4e926f59f3c397c72f9670556f3716.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_62c93984919ef2ea34d13229ae9f1ee3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_1b028c1283d4223b8cbb2d853be42932.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_ab73f81e203e8767bec71b357d8a4d5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_7aa597366326095ad8b6255995342b4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_b2929d9f68a3f24a1d600733f52a8f02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_64b09bf3ad41b36d3d31b417537b2bbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b254d90-a747-52c8-9427-02d30dfb1c18/3b254d90-a747-52c8-9427-02d30dfb1c18_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a927299fc78224c6edf4ce58d4e9497/pa/AH42786_5a8eb63fe951bd4fde5e1a7d03d13004.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Shooting Brake 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-30 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH42786%27 HTTP/1.1" 200 None
2026-03-30 09:03:44 [auto1.it] INFO: Saving data for AH42786: {'created_time': 1774861424.376806, 'last_price_update_time': 1774861424.376818, 'auction_closing_time': 1774971713.0}
2026-03-30 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AH42786') HTTP/1.1" 204 0
2026-03-30 09:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dc1bf32c-02f1-534e-ab85-18a8d6515c65 with identifier: WG28581
2026-03-30 09:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dc1bf32c-02f1-534e-ab85-18a8d6515c65 with identifier: WG28581
2026-03-30 09:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dc1bf32c-02f1-534e-ab85-18a8d6515c65 with identifier: WG28581 to the API
2026-03-30 09:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WG28581>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 299,
 'expiration_date': '2026-03-31T15:36:30Z',
 'fuel_type': 'hybrid',
 'id': 'dc1bf32c-02f1-534e-ab85-18a8d6515c65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG28581',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 17133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_ed8bc6272b2821b291ab76a247939011.jpg',
                'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_bf6e0327d3fbc15d4556d7c951531fcb.jpg',
                'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_86d180eee7b3f334a4197302effe7b03.jpg',
                'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_3adccb90af70d20e51922888ee6e36e5.jpg',
                'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_f9164fc43f0ccf16b72aa3780d10e926.jpg',
                'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_481fc9666df9ab1459d5d6a91771d0e9.jpg',
                'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_08bee44823f8cacc3c3b18878bbab9c4.jpg',
                'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_deb8d83ba36ec122baede1a8097e19b7.jpg',
                'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_751e384027f51377602b6471abb4622f.jpg',
                'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_22f50cfde7d2bdc9bcaccbd3b43ae048.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1bf32c-02f1-534e-ab85-18a8d6515c65/dc1bf32c-02f1-534e-ab85-18a8d6515c65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_ed8bc6272b2821b291ab76a247939011.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1bf32c-02f1-534e-ab85-18a8d6515c65/dc1bf32c-02f1-534e-ab85-18a8d6515c65_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_bf6e0327d3fbc15d4556d7c951531fcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1bf32c-02f1-534e-ab85-18a8d6515c65/dc1bf32c-02f1-534e-ab85-18a8d6515c65_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_86d180eee7b3f334a4197302effe7b03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1bf32c-02f1-534e-ab85-18a8d6515c65/dc1bf32c-02f1-534e-ab85-18a8d6515c65_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_3adccb90af70d20e51922888ee6e36e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1bf32c-02f1-534e-ab85-18a8d6515c65/dc1bf32c-02f1-534e-ab85-18a8d6515c65_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_f9164fc43f0ccf16b72aa3780d10e926.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1bf32c-02f1-534e-ab85-18a8d6515c65/dc1bf32c-02f1-534e-ab85-18a8d6515c65_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_481fc9666df9ab1459d5d6a91771d0e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1bf32c-02f1-534e-ab85-18a8d6515c65/dc1bf32c-02f1-534e-ab85-18a8d6515c65_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_08bee44823f8cacc3c3b18878bbab9c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1bf32c-02f1-534e-ab85-18a8d6515c65/dc1bf32c-02f1-534e-ab85-18a8d6515c65_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_deb8d83ba36ec122baede1a8097e19b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1bf32c-02f1-534e-ab85-18a8d6515c65/dc1bf32c-02f1-534e-ab85-18a8d6515c65_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_751e384027f51377602b6471abb4622f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1bf32c-02f1-534e-ab85-18a8d6515c65/dc1bf32c-02f1-534e-ab85-18a8d6515c65_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ac/b1ac00ce95d3da8518a1807aef957fcc/pa/WG28581_22f50cfde7d2bdc9bcaccbd3b43ae048.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 50 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2024}
2026-03-30 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG28581%27 HTTP/1.1" 200 None
2026-03-30 09:03:44 [auto1.it] INFO: Saving data for WG28581: {'created_time': 1774861424.940942, 'last_price_update_time': 1774861424.940958, 'auction_closing_time': 1774971390.0}
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WG28581') HTTP/1.1" 204 0
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_b18d2a0d0c4482e2f5b9ab95c21d018b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_b18d2a0d0c4482e2f5b9ab95c21d018b.jpg not downloaded yet
2026-03-30 09:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82e9071e-a7b7-5689-8fa1-5a449fc96fe2 with identifier: DD76151
2026-03-30 09:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82e9071e-a7b7-5689-8fa1-5a449fc96fe2 with identifier: DD76151
2026-03-30 09:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82e9071e-a7b7-5689-8fa1-5a449fc96fe2 with identifier: DD76151 to the API
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:33:58Z',
 'fuel_type': 'diesel',
 'id': '82e9071e-a7b7-5689-8fa1-5a449fc96fe2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD76151',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 165687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-27',
 'seller_name': None,
 'title': 'BMW 1er 116d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD76151%27 HTTP/1.1" 200 None
2026-03-30 09:03:45 [auto1.it] INFO: Saving data for DD76151: {'auction_closing_time': 1774971238.0, 'created_time': 1774386083.722245, 'last_price_update_time': 1774861425.570253}
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DD76151') HTTP/1.1" 204 0
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa1%252Fada1f4a89f11059afd8f8668970896c6%252Fpa%252FPN24411_b83179096ff35e2d6691426629e98aa6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_b83179096ff35e2d6691426629e98aa6.jpg not downloaded yet
2026-03-30 09:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06296a50>
2026-03-30 09:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915a2653-b8e1-5518-a3a7-f5cc0485b980/915a2653-b8e1-5518-a3a7-f5cc0485b980_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a898691cfa6e282f1bf2edc094ac1d%252Fpa%252FXR25970_74986774c38f85522d5cfa4f9db80905.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_74986774c38f85522d5cfa4f9db80905.jpg saved to cache
2026-03-30 09:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 915a2653-b8e1-5518-a3a7-f5cc0485b980
2026-03-30 09:03:45 [auto1.it] INFO: Found listing with ID: XY70829
2026-03-30 09:03:45 [auto1.it] INFO: Found listing with ID: RX26754
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX26754%27 HTTP/1.1" 200 None
2026-03-30 09:03:45 [auto1.it] INFO: Scrape type for RX26754: 2
2026-03-30 09:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64d43529-b24c-56b4-9a49-c55218de6341 with identifier: RX26754
2026-03-30 09:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64d43529-b24c-56b4-9a49-c55218de6341 with scrape type 2
2026-03-30 09:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64d43529-b24c-56b4-9a49-c55218de6341 with scrape type 2
2026-03-30 09:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 64d43529-b24c-56b4-9a49-c55218de6341, identifier: RX26754
2026-03-30 09:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_f76629dc093f48b382ca43ea57cf9c73.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_2d850ab8c51c5159ba0685cecc4f61ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_2d850ab8c51c5159ba0685cecc4f61ce.jpg not downloaded yet
2026-03-30 09:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 64d43529-b24c-56b4-9a49-c55218de6341 with identifier: RX26754
2026-03-30 09:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 64d43529-b24c-56b4-9a49-c55218de6341 with identifier: RX26754
2026-03-30 09:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 64d43529-b24c-56b4-9a49-c55218de6341 with identifier: RX26754 to the API
2026-03-30 09:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:16:42Z',
 'fuel_type': 'diesel',
 'id': '64d43529-b24c-56b4-9a49-c55218de6341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX26754',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 135846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-20',
 'seller_name': None,
 'title': 'BMW 7er 730d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2015}
2026-03-30 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX26754%27 HTTP/1.1" 200 None
2026-03-30 09:03:46 [auto1.it] INFO: Saving data for RX26754: {'auction_closing_time': 1774970202.0, 'created_time': 1774342897.696631, 'last_price_update_time': 1774861426.566776}
2026-03-30 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX26754') HTTP/1.1" 204 0
2026-03-30 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa1%252Fada1f4a89f11059afd8f8668970896c6%252Fpa%252FPN24411_6d26d27b19aac9089aae840790ef088b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_6d26d27b19aac9089aae840790ef088b.jpg not downloaded yet
2026-03-30 09:03:46 [auto1.it] INFO: Found listing with ID: BE00286
2026-03-30 09:03:46 [auto1.it] INFO: Found listing with ID: ZA41096
2026-03-30 09:03:46 [auto1.it] INFO: Found listing with ID: US42415
2026-03-30 09:03:46 [auto1.it] INFO: Found listing with ID: UK52269
2026-03-30 09:03:46 [auto1.it] INFO: Found listing with ID: GM47184
2026-03-30 09:03:46 [auto1.it] INFO: Found listing with ID: LA93311
2026-03-30 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA93311%27 HTTP/1.1" 200 None
2026-03-30 09:03:46 [auto1.it] INFO: Scrape type for LA93311: 2
2026-03-30 09:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb54154f-6fc6-5dc4-8b08-bf4b6fe48bed with identifier: LA93311
2026-03-30 09:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb54154f-6fc6-5dc4-8b08-bf4b6fe48bed with scrape type 2
2026-03-30 09:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb54154f-6fc6-5dc4-8b08-bf4b6fe48bed with scrape type 2
2026-03-30 09:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb54154f-6fc6-5dc4-8b08-bf4b6fe48bed, identifier: LA93311
2026-03-30 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_fc5ba308640b9913819e258338e5db41.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_fc5ba308640b9913819e258338e5db41.jpg not downloaded yet
2026-03-30 09:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb54154f-6fc6-5dc4-8b08-bf4b6fe48bed with identifier: LA93311
2026-03-30 09:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb54154f-6fc6-5dc4-8b08-bf4b6fe48bed with identifier: LA93311
2026-03-30 09:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bb54154f-6fc6-5dc4-8b08-bf4b6fe48bed with identifier: LA93311 to the API
2026-03-30 09:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:13:09Z',
 'fuel_type': 'diesel',
 'id': 'bb54154f-6fc6-5dc4-8b08-bf4b6fe48bed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA93311',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 334526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-20',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2015}
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA93311%27 HTTP/1.1" 200 None
2026-03-30 09:03:47 [auto1.it] INFO: Saving data for LA93311: {'auction_closing_time': 1774969989.0, 'created_time': 1773130067.102537, 'last_price_update_time': 1774861427.26681}
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LA93311') HTTP/1.1" 204 0
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa1%252Fada1f4a89f11059afd8f8668970896c6%252Fpa%252FPN24411_d1e308787f1e936ceb9f58a3becc4d92.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_d1e308787f1e936ceb9f58a3becc4d92.jpg not downloaded yet
2026-03-30 09:03:47 [auto1.it] INFO: Found listing with ID: YF99217
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF99217%27 HTTP/1.1" 200 None
2026-03-30 09:03:47 [auto1.it] INFO: Scrape type for YF99217: 2
2026-03-30 09:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 460bf4f7-1b88-57d7-a1ed-4080efe02a0c with identifier: YF99217
2026-03-30 09:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 460bf4f7-1b88-57d7-a1ed-4080efe02a0c with scrape type 2
2026-03-30 09:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 460bf4f7-1b88-57d7-a1ed-4080efe02a0c with scrape type 2
2026-03-30 09:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 460bf4f7-1b88-57d7-a1ed-4080efe02a0c, identifier: YF99217
2026-03-30 09:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 460bf4f7-1b88-57d7-a1ed-4080efe02a0c with identifier: YF99217
2026-03-30 09:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 460bf4f7-1b88-57d7-a1ed-4080efe02a0c with identifier: YF99217
2026-03-30 09:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 460bf4f7-1b88-57d7-a1ed-4080efe02a0c with identifier: YF99217 to the API
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:14:23Z',
 'fuel_type': 'petrol',
 'id': '460bf4f7-1b88-57d7-a1ed-4080efe02a0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF99217',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 86976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-18',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet TURBO S 4x4',
 'transmission': 'manual',
 'trim': 'TURBO S 4x4',
 'year': 2017}
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF99217%27 HTTP/1.1" 200 None
2026-03-30 09:03:47 [auto1.it] INFO: Saving data for YF99217: {'auction_closing_time': 1774970063.0, 'created_time': 1774447261.473973, 'last_price_update_time': 1774861427.899611}
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YF99217') HTTP/1.1" 204 0
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa1%252Fada1f4a89f11059afd8f8668970896c6%252Fpa%252FPN24411_c2412be36411d7ef1a5a592988712c71.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_c2412be36411d7ef1a5a592988712c71.jpg not downloaded yet
2026-03-30 09:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d9c650>
2026-03-30 09:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_f76629dc093f48b382ca43ea57cf9c73.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_f76629dc093f48b382ca43ea57cf9c73.jpg saved to cache
2026-03-30 09:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0066079f-1ba1-5322-810b-b31ff6e67689
2026-03-30 09:03:48 [auto1.it] INFO: Found listing with ID: MD20414
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD20414%27 HTTP/1.1" 200 None
2026-03-30 09:03:48 [auto1.it] INFO: Scrape type for MD20414: 2
2026-03-30 09:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8574b748-676e-52db-bbde-bb80be2ade10 with identifier: MD20414
2026-03-30 09:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8574b748-676e-52db-bbde-bb80be2ade10 with scrape type 2
2026-03-30 09:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8574b748-676e-52db-bbde-bb80be2ade10 with scrape type 2
2026-03-30 09:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8574b748-676e-52db-bbde-bb80be2ade10, identifier: MD20414
2026-03-30 09:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8574b748-676e-52db-bbde-bb80be2ade10 with identifier: MD20414
2026-03-30 09:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8574b748-676e-52db-bbde-bb80be2ade10 with identifier: MD20414
2026-03-30 09:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8574b748-676e-52db-bbde-bb80be2ade10 with identifier: MD20414 to the API
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:01:54Z',
 'fuel_type': 'diesel',
 'id': '8574b748-676e-52db-bbde-bb80be2ade10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD20414',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 173284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-31',
 'seller_name': None,
 'title': 'Volvo V60 1.6 D Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2015}
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD20414%27 HTTP/1.1" 200 None
2026-03-30 09:03:48 [auto1.it] INFO: Saving data for MD20414: {'auction_closing_time': 1774969314.0, 'created_time': 1774353664.110997, 'last_price_update_time': 1774861428.571707}
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MD20414') HTTP/1.1" 204 0
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa1%252Fada1f4a89f11059afd8f8668970896c6%252Fpa%252FPN24411_25e03d2cbf2517e1e47ca43009d5dd3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_25e03d2cbf2517e1e47ca43009d5dd3d.jpg not downloaded yet
2026-03-30 09:03:48 [auto1.it] INFO: Found listing with ID: TM85458
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM85458%27 HTTP/1.1" 200 None
2026-03-30 09:03:48 [auto1.it] INFO: Scrape type for TM85458: 2
2026-03-30 09:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9882d99a-4877-5705-8f98-31549aa94c6a with identifier: TM85458
2026-03-30 09:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9882d99a-4877-5705-8f98-31549aa94c6a with scrape type 2
2026-03-30 09:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9882d99a-4877-5705-8f98-31549aa94c6a with scrape type 2
2026-03-30 09:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9882d99a-4877-5705-8f98-31549aa94c6a, identifier: TM85458
2026-03-30 09:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9882d99a-4877-5705-8f98-31549aa94c6a with identifier: TM85458
2026-03-30 09:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9882d99a-4877-5705-8f98-31549aa94c6a with identifier: TM85458
2026-03-30 09:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9882d99a-4877-5705-8f98-31549aa94c6a with identifier: TM85458 to the API
2026-03-30 09:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:42:11Z',
 'fuel_type': 'diesel',
 'id': '9882d99a-4877-5705-8f98-31549aa94c6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM85458',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 174616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-06',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi Classic 2WD',
 'transmission': 'manual',
 'trim': 'Classic 2WD',
 'year': 2014}
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM85458%27 HTTP/1.1" 200 None
2026-03-30 09:03:49 [auto1.it] INFO: Saving data for TM85458: {'auction_closing_time': 1774971731.0, 'created_time': 1773268458.456832, 'last_price_update_time': 1774861429.185572}
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TM85458') HTTP/1.1" 204 0
2026-03-30 09:03:49 [auto1.it] INFO: Found listing with ID: CL69303
2026-03-30 09:03:49 [auto1.it] INFO: Found listing with ID: NA96528
2026-03-30 09:03:49 [auto1.it] INFO: Found listing with ID: JU96754
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU96754%27 HTTP/1.1" 200 None
2026-03-30 09:03:49 [auto1.it] INFO: Scrape type for JU96754: 2
2026-03-30 09:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e2303a-4ad1-5f3a-a0b3-cc411dde37bb with identifier: JU96754
2026-03-30 09:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e2303a-4ad1-5f3a-a0b3-cc411dde37bb with scrape type 2
2026-03-30 09:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89e2303a-4ad1-5f3a-a0b3-cc411dde37bb with scrape type 2
2026-03-30 09:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 89e2303a-4ad1-5f3a-a0b3-cc411dde37bb, identifier: JU96754
2026-03-30 09:03:49 [auto1.it] INFO: Channel: 24h | Page: 16 | totalHits: 3297 | hits on page: 40
2026-03-30 09:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 89e2303a-4ad1-5f3a-a0b3-cc411dde37bb with identifier: JU96754
2026-03-30 09:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 89e2303a-4ad1-5f3a-a0b3-cc411dde37bb with identifier: JU96754
2026-03-30 09:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 89e2303a-4ad1-5f3a-a0b3-cc411dde37bb with identifier: JU96754 to the API
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:55:00Z',
 'fuel_type': 'diesel',
 'id': '89e2303a-4ad1-5f3a-a0b3-cc411dde37bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU96754',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 208374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-12',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 CDTI DPF B-Color ecoFlex',
 'transmission': 'manual',
 'trim': 'B-Color ecoFlex',
 'year': 2015}
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU96754%27 HTTP/1.1" 200 None
2026-03-30 09:03:49 [auto1.it] INFO: Saving data for JU96754: {'auction_closing_time': 1774972500.0, 'created_time': 1774386104.785102, 'last_price_update_time': 1774861429.806108}
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JU96754') HTTP/1.1" 204 0
2026-03-30 09:03:49 [auto1.it] INFO: Found listing with ID: DU75203
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU75203%27 HTTP/1.1" 200 None
2026-03-30 09:03:49 [auto1.it] INFO: Scrape type for DU75203: 2
2026-03-30 09:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca466916-7bae-5517-94e7-10155b6496e6 with identifier: DU75203
2026-03-30 09:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca466916-7bae-5517-94e7-10155b6496e6 with scrape type 2
2026-03-30 09:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca466916-7bae-5517-94e7-10155b6496e6 with scrape type 2
2026-03-30 09:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ca466916-7bae-5517-94e7-10155b6496e6, identifier: DU75203
2026-03-30 09:03:50 [auto1.it] INFO: Found listing with ID: YX27089
2026-03-30 09:03:50 [auto1.it] INFO: Found listing with ID: MH41109
2026-03-30 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH41109%27 HTTP/1.1" 200 None
2026-03-30 09:03:50 [auto1.it] INFO: Scrape type for MH41109: 2
2026-03-30 09:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 843e4224-204b-5a64-88da-a6d6cafe05cb with identifier: MH41109
2026-03-30 09:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 843e4224-204b-5a64-88da-a6d6cafe05cb with scrape type 2
2026-03-30 09:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 843e4224-204b-5a64-88da-a6d6cafe05cb with scrape type 2
2026-03-30 09:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 843e4224-204b-5a64-88da-a6d6cafe05cb, identifier: MH41109
2026-03-30 09:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ca466916-7bae-5517-94e7-10155b6496e6 with identifier: DU75203
2026-03-30 09:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ca466916-7bae-5517-94e7-10155b6496e6 with identifier: DU75203
2026-03-30 09:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ca466916-7bae-5517-94e7-10155b6496e6 with identifier: DU75203 to the API
2026-03-30 09:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 232,
 'expiration_date': '2026-03-31T15:27:13Z',
 'fuel_type': 'diesel',
 'id': 'ca466916-7bae-5517-94e7-10155b6496e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU75203',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 313181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-30',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2007}
2026-03-30 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU75203%27 HTTP/1.1" 200 None
2026-03-30 09:03:50 [auto1.it] INFO: Saving data for DU75203: {'auction_closing_time': 1774970833.0, 'created_time': 1773954755.580413, 'last_price_update_time': 1774861430.822561}
2026-03-30 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DU75203') HTTP/1.1" 204 0
2026-03-30 09:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 843e4224-204b-5a64-88da-a6d6cafe05cb with identifier: MH41109
2026-03-30 09:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 843e4224-204b-5a64-88da-a6d6cafe05cb with identifier: MH41109
2026-03-30 09:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 843e4224-204b-5a64-88da-a6d6cafe05cb with identifier: MH41109 to the API
2026-03-30 09:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:30:24Z',
 'fuel_type': 'petrol',
 'id': '843e4224-204b-5a64-88da-a6d6cafe05cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH41109',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 36505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-22',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet ICool',
 'transmission': 'manual',
 'trim': 'ICool',
 'year': 2019}
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH41109%27 HTTP/1.1" 200 None
2026-03-30 09:03:51 [auto1.it] INFO: Saving data for MH41109: {'auction_closing_time': 1774971024.0, 'created_time': 1773231946.159142, 'last_price_update_time': 1774861431.269235}
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MH41109') HTTP/1.1" 204 0
2026-03-30 09:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_99e0fc0624d53c067e150559286552b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:51 [auto1.it] INFO: Found listing with ID: PC80500
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC80500%27 HTTP/1.1" 200 None
2026-03-30 09:03:51 [auto1.it] INFO: Scrape type for PC80500: 2
2026-03-30 09:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b6f175c-85d9-5378-a23b-96d2dafbdcf8 with identifier: PC80500
2026-03-30 09:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6f175c-85d9-5378-a23b-96d2dafbdcf8 with scrape type 2
2026-03-30 09:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b6f175c-85d9-5378-a23b-96d2dafbdcf8 with scrape type 2
2026-03-30 09:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b6f175c-85d9-5378-a23b-96d2dafbdcf8, identifier: PC80500
2026-03-30 09:03:51 [auto1.it] INFO: Found listing with ID: XV30481
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV30481%27 HTTP/1.1" 200 None
2026-03-30 09:03:51 [auto1.it] INFO: Scrape type for XV30481: 2
2026-03-30 09:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c67382af-fc4d-5c2b-9a6e-84659a1c12f7 with identifier: XV30481
2026-03-30 09:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c67382af-fc4d-5c2b-9a6e-84659a1c12f7 with scrape type 2
2026-03-30 09:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c67382af-fc4d-5c2b-9a6e-84659a1c12f7 with scrape type 2
2026-03-30 09:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c67382af-fc4d-5c2b-9a6e-84659a1c12f7, identifier: XV30481
2026-03-30 09:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b6f175c-85d9-5378-a23b-96d2dafbdcf8 with identifier: PC80500
2026-03-30 09:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b6f175c-85d9-5378-a23b-96d2dafbdcf8 with identifier: PC80500
2026-03-30 09:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b6f175c-85d9-5378-a23b-96d2dafbdcf8 with identifier: PC80500 to the API
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:22:12Z',
 'fuel_type': 'petrol',
 'id': '6b6f175c-85d9-5378-a23b-96d2dafbdcf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC80500',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 154785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-05',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Cosmo ecoFlex',
 'transmission': 'manual',
 'trim': 'Cosmo ecoFlex',
 'year': 2014}
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC80500%27 HTTP/1.1" 200 None
2026-03-30 09:03:51 [auto1.it] INFO: Saving data for PC80500: {'auction_closing_time': 1774970532.0, 'created_time': 1774386091.845015, 'last_price_update_time': 1774861431.878783}
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PC80500') HTTP/1.1" 204 0
2026-03-30 09:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c67382af-fc4d-5c2b-9a6e-84659a1c12f7 with identifier: XV30481
2026-03-30 09:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c67382af-fc4d-5c2b-9a6e-84659a1c12f7 with identifier: XV30481
2026-03-30 09:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c67382af-fc4d-5c2b-9a6e-84659a1c12f7 with identifier: XV30481 to the API
2026-03-30 09:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:01:23Z',
 'fuel_type': 'petrol',
 'id': 'c67382af-fc4d-5c2b-9a6e-84659a1c12f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV30481',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 199718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-24',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T4 Momentum 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum 2WD',
 'year': 2018}
2026-03-30 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV30481%27 HTTP/1.1" 200 None
2026-03-30 09:03:52 [auto1.it] INFO: Saving data for XV30481: {'auction_closing_time': 1774969283.0, 'created_time': 1773130758.834155, 'last_price_update_time': 1774861432.553297}
2026-03-30 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XV30481') HTTP/1.1" 204 0
2026-03-30 09:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:03:52 [auto1.it] INFO: Found listing with ID: UH68033
2026-03-30 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH68033%27 HTTP/1.1" 200 None
2026-03-30 09:03:52 [auto1.it] INFO: Scrape type for UH68033: 2
2026-03-30 09:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d9c54b1-6fad-5126-9136-f64bea74b6d9 with identifier: UH68033
2026-03-30 09:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d9c54b1-6fad-5126-9136-f64bea74b6d9 with scrape type 2
2026-03-30 09:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d9c54b1-6fad-5126-9136-f64bea74b6d9 with scrape type 2
2026-03-30 09:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8d9c54b1-6fad-5126-9136-f64bea74b6d9, identifier: UH68033
2026-03-30 09:03:52 [auto1.it] INFO: Found listing with ID: HA24059
2026-03-30 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA24059%27 HTTP/1.1" 200 None
2026-03-30 09:03:52 [auto1.it] INFO: Scrape type for HA24059: 2
2026-03-30 09:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26aefd72-7e0a-5b25-a44a-e01dc5d0834e with identifier: HA24059
2026-03-30 09:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26aefd72-7e0a-5b25-a44a-e01dc5d0834e with scrape type 2
2026-03-30 09:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26aefd72-7e0a-5b25-a44a-e01dc5d0834e with scrape type 2
2026-03-30 09:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26aefd72-7e0a-5b25-a44a-e01dc5d0834e, identifier: HA24059
2026-03-30 09:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8d9c54b1-6fad-5126-9136-f64bea74b6d9 with identifier: UH68033
2026-03-30 09:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8d9c54b1-6fad-5126-9136-f64bea74b6d9 with identifier: UH68033
2026-03-30 09:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8d9c54b1-6fad-5126-9136-f64bea74b6d9 with identifier: UH68033 to the API
2026-03-30 09:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:24:11Z',
 'fuel_type': 'diesel',
 'id': '8d9c54b1-6fad-5126-9136-f64bea74b6d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH68033',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 163800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-24',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH68033%27 HTTP/1.1" 200 None
2026-03-30 09:03:53 [auto1.it] INFO: Saving data for UH68033: {'auction_closing_time': 1774970651.0, 'created_time': 1773231722.86829, 'last_price_update_time': 1774861433.292576}
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UH68033') HTTP/1.1" 204 0
2026-03-30 09:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26aefd72-7e0a-5b25-a44a-e01dc5d0834e with identifier: HA24059
2026-03-30 09:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26aefd72-7e0a-5b25-a44a-e01dc5d0834e with identifier: HA24059
2026-03-30 09:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26aefd72-7e0a-5b25-a44a-e01dc5d0834e with identifier: HA24059 to the API
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:14:01Z',
 'fuel_type': 'petrol',
 'id': '26aefd72-7e0a-5b25-a44a-e01dc5d0834e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA24059',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 221081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-17',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2007}
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA24059%27 HTTP/1.1" 200 None
2026-03-30 09:03:53 [auto1.it] INFO: Saving data for HA24059: {'auction_closing_time': 1774970041.0, 'created_time': 1774559115.777617, 'last_price_update_time': 1774861433.779792}
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HA24059') HTTP/1.1" 204 0
2026-03-30 09:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d054f90>
2026-03-30 09:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_99e0fc0624d53c067e150559286552b2.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_99e0fc0624d53c067e150559286552b2.jpg saved to cache
2026-03-30 09:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea036585-d06d-57db-92c9-a238b1e2a9ac
2026-03-30 09:03:53 [auto1.it] INFO: Found listing with ID: RK56494
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK56494%27 HTTP/1.1" 200 None
2026-03-30 09:03:53 [auto1.it] INFO: Scrape type for RK56494: 2
2026-03-30 09:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3cdcc56-135d-5480-be50-ec279f9fa6e6 with identifier: RK56494
2026-03-30 09:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3cdcc56-135d-5480-be50-ec279f9fa6e6 with scrape type 2
2026-03-30 09:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3cdcc56-135d-5480-be50-ec279f9fa6e6 with scrape type 2
2026-03-30 09:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d3cdcc56-135d-5480-be50-ec279f9fa6e6, identifier: RK56494
2026-03-30 09:03:54 [auto1.it] INFO: Found listing with ID: HA49893
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA49893%27 HTTP/1.1" 200 None
2026-03-30 09:03:54 [auto1.it] INFO: Scrape type for HA49893: 2
2026-03-30 09:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c068efba-82da-5f58-a662-f6fb57f6a658 with identifier: HA49893
2026-03-30 09:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c068efba-82da-5f58-a662-f6fb57f6a658 with scrape type 2
2026-03-30 09:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c068efba-82da-5f58-a662-f6fb57f6a658 with scrape type 2
2026-03-30 09:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c068efba-82da-5f58-a662-f6fb57f6a658, identifier: HA49893
2026-03-30 09:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_63bfd0520f43b96eae19ba5571c804f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d3cdcc56-135d-5480-be50-ec279f9fa6e6 with identifier: RK56494
2026-03-30 09:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d3cdcc56-135d-5480-be50-ec279f9fa6e6 with identifier: RK56494
2026-03-30 09:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d3cdcc56-135d-5480-be50-ec279f9fa6e6 with identifier: RK56494 to the API
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:44:23Z',
 'fuel_type': 'diesel',
 'id': 'd3cdcc56-135d-5480-be50-ec279f9fa6e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK56494',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 168468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T Classic',
 'transmission': 'automatic',
 'trim': 'T Classic',
 'year': 2010}
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK56494%27 HTTP/1.1" 200 None
2026-03-30 09:03:54 [auto1.it] INFO: Saving data for RK56494: {'auction_closing_time': 1774971863.0, 'created_time': 1773997439.31616, 'last_price_update_time': 1774861434.492085}
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RK56494') HTTP/1.1" 204 0
2026-03-30 09:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c068efba-82da-5f58-a662-f6fb57f6a658 with identifier: HA49893
2026-03-30 09:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c068efba-82da-5f58-a662-f6fb57f6a658 with identifier: HA49893
2026-03-30 09:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c068efba-82da-5f58-a662-f6fb57f6a658 with identifier: HA49893 to the API
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:07:48Z',
 'fuel_type': 'diesel',
 'id': 'c068efba-82da-5f58-a662-f6fb57f6a658',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA49893',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 331764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-28',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2011}
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA49893%27 HTTP/1.1" 200 None
2026-03-30 09:03:54 [auto1.it] INFO: Saving data for HA49893: {'auction_closing_time': 1774969668.0, 'created_time': 1774440035.151118, 'last_price_update_time': 1774861434.868889}
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HA49893') HTTP/1.1" 204 0
2026-03-30 09:03:54 [auto1.it] INFO: Found listing with ID: HB38869
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB38869%27 HTTP/1.1" 200 None
2026-03-30 09:03:54 [auto1.it] INFO: Scrape type for HB38869: 2
2026-03-30 09:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3189dabf-c4db-5ca3-abd9-e7b2cfd0539a with identifier: HB38869
2026-03-30 09:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3189dabf-c4db-5ca3-abd9-e7b2cfd0539a with scrape type 2
2026-03-30 09:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3189dabf-c4db-5ca3-abd9-e7b2cfd0539a with scrape type 2
2026-03-30 09:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3189dabf-c4db-5ca3-abd9-e7b2cfd0539a, identifier: HB38869
2026-03-30 09:03:55 [auto1.it] INFO: Found listing with ID: FK89155
2026-03-30 09:03:55 [auto1.it] INFO: Found listing with ID: MJ37367
2026-03-30 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ37367%27 HTTP/1.1" 200 None
2026-03-30 09:03:55 [auto1.it] INFO: Scrape type for MJ37367: 2
2026-03-30 09:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fb6165a-ec10-53d8-8091-a437242b796e with identifier: MJ37367
2026-03-30 09:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb6165a-ec10-53d8-8091-a437242b796e with scrape type 2
2026-03-30 09:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fb6165a-ec10-53d8-8091-a437242b796e with scrape type 2
2026-03-30 09:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0fb6165a-ec10-53d8-8091-a437242b796e, identifier: MJ37367
2026-03-30 09:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_9c84d03095e2c36a0969eaa76f3f602b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3189dabf-c4db-5ca3-abd9-e7b2cfd0539a with identifier: HB38869
2026-03-30 09:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3189dabf-c4db-5ca3-abd9-e7b2cfd0539a with identifier: HB38869
2026-03-30 09:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3189dabf-c4db-5ca3-abd9-e7b2cfd0539a with identifier: HB38869 to the API
2026-03-30 09:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 222,
 'expiration_date': '2026-03-31T15:57:11Z',
 'fuel_type': 'hybrid',
 'id': '3189dabf-c4db-5ca3-abd9-e7b2cfd0539a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB38869',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 60126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-24',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x4 Lounge',
 'transmission': 'automatic',
 'trim': '4x4 Lounge',
 'year': 2021}
2026-03-30 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB38869%27 HTTP/1.1" 200 None
2026-03-30 09:03:55 [auto1.it] INFO: Saving data for HB38869: {'auction_closing_time': 1774972631.0, 'created_time': 1773502038.137735, 'last_price_update_time': 1774861435.7548}
2026-03-30 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HB38869') HTTP/1.1" 204 0
2026-03-30 09:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0fb6165a-ec10-53d8-8091-a437242b796e with identifier: MJ37367
2026-03-30 09:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0fb6165a-ec10-53d8-8091-a437242b796e with identifier: MJ37367
2026-03-30 09:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0fb6165a-ec10-53d8-8091-a437242b796e with identifier: MJ37367 to the API
2026-03-30 09:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-31T15:23:08Z',
 'fuel_type': 'diesel',
 'id': '0fb6165a-ec10-53d8-8091-a437242b796e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ37367',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 100384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'Jaguar XF 3.0 D V6 S Premium Luxury',
 'transmission': 'automatic',
 'trim': 'S Premium Luxury',
 'year': 2011}
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ37367%27 HTTP/1.1" 200 None
2026-03-30 09:03:56 [auto1.it] INFO: Saving data for MJ37367: {'auction_closing_time': 1774970588.0, 'created_time': 1773910936.635565, 'last_price_update_time': 1774861436.089523}
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MJ37367') HTTP/1.1" 204 0
2026-03-30 09:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_b2ec5701fced2fa0fbbd90d2a20f9dd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:56 [auto1.it] INFO: Found listing with ID: WG31996
2026-03-30 09:03:56 [auto1.it] INFO: Found listing with ID: YN37563
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN37563%27 HTTP/1.1" 200 None
2026-03-30 09:03:56 [auto1.it] INFO: Scrape type for YN37563: 2
2026-03-30 09:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3130185-c2c3-59d0-b547-a6d1cab7ff08 with identifier: YN37563
2026-03-30 09:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3130185-c2c3-59d0-b547-a6d1cab7ff08 with scrape type 2
2026-03-30 09:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3130185-c2c3-59d0-b547-a6d1cab7ff08 with scrape type 2
2026-03-30 09:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b3130185-c2c3-59d0-b547-a6d1cab7ff08, identifier: YN37563
2026-03-30 09:03:56 [auto1.it] INFO: Found listing with ID: AJ71510
2026-03-30 09:03:56 [auto1.it] INFO: Found listing with ID: VB16159
2026-03-30 09:03:56 [auto1.it] INFO: Found listing with ID: BH25035
2026-03-30 09:03:56 [auto1.it] INFO: Found listing with ID: RC86938
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC86938%27 HTTP/1.1" 200 None
2026-03-30 09:03:56 [auto1.it] INFO: Scrape type for RC86938: 2
2026-03-30 09:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 657cb867-96ee-539e-a8fb-93a64f18c04c with identifier: RC86938
2026-03-30 09:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 657cb867-96ee-539e-a8fb-93a64f18c04c with scrape type 2
2026-03-30 09:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 657cb867-96ee-539e-a8fb-93a64f18c04c with scrape type 2
2026-03-30 09:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 657cb867-96ee-539e-a8fb-93a64f18c04c, identifier: RC86938
2026-03-30 09:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_aa03cf1faf915b54c255e447b984d71f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b3130185-c2c3-59d0-b547-a6d1cab7ff08 with identifier: YN37563
2026-03-30 09:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b3130185-c2c3-59d0-b547-a6d1cab7ff08 with identifier: YN37563
2026-03-30 09:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b3130185-c2c3-59d0-b547-a6d1cab7ff08 with identifier: YN37563 to the API
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 107,
 'expiration_date': '2026-03-31T15:31:34Z',
 'fuel_type': 'petrol',
 'id': 'b3130185-c2c3-59d0-b547-a6d1cab7ff08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN37563',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Sedici',
 'odometer': 116353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-25',
 'seller_name': None,
 'title': 'Fiat Sedici 1.6 Emotion 4x4',
 'transmission': 'manual',
 'trim': 'Emotion 4x4',
 'year': 2009}
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN37563%27 HTTP/1.1" 200 None
2026-03-30 09:03:56 [auto1.it] INFO: Saving data for YN37563: {'auction_closing_time': 1774971094.0, 'created_time': 1774342998.157606, 'last_price_update_time': 1774861436.696011}
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YN37563') HTTP/1.1" 204 0
2026-03-30 09:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 657cb867-96ee-539e-a8fb-93a64f18c04c with identifier: RC86938
2026-03-30 09:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 657cb867-96ee-539e-a8fb-93a64f18c04c with identifier: RC86938
2026-03-30 09:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 657cb867-96ee-539e-a8fb-93a64f18c04c with identifier: RC86938 to the API
2026-03-30 09:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:24:35Z',
 'fuel_type': 'diesel',
 'id': '657cb867-96ee-539e-a8fb-93a64f18c04c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC86938',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 144131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-22',
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Class 2WD',
 'transmission': 'manual',
 'trim': 'Class 2WD',
 'year': 2012}
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC86938%27 HTTP/1.1" 200 None
2026-03-30 09:03:57 [auto1.it] INFO: Saving data for RC86938: {'auction_closing_time': 1774970675.0, 'created_time': 1774447304.213692, 'last_price_update_time': 1774861437.198274}
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RC86938') HTTP/1.1" 204 0
2026-03-30 09:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e5e3d0>
2026-03-30 09:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915a2653-b8e1-5518-a3a7-f5cc0485b980/915a2653-b8e1-5518-a3a7-f5cc0485b980_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a898691cfa6e282f1bf2edc094ac1d%252Fpa%252FXR25970_63bfd0520f43b96eae19ba5571c804f6.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_63bfd0520f43b96eae19ba5571c804f6.jpg saved to cache
2026-03-30 09:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 915a2653-b8e1-5518-a3a7-f5cc0485b980
2026-03-30 09:03:57 [auto1.it] INFO: Found listing with ID: LT20322
2026-03-30 09:03:57 [auto1.it] INFO: Found listing with ID: VV14244
2026-03-30 09:03:57 [auto1.it] INFO: Found listing with ID: VK01917
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK01917%27 HTTP/1.1" 200 None
2026-03-30 09:03:57 [auto1.it] INFO: Scrape type for VK01917: 2
2026-03-30 09:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8edb7f5-cf65-5c08-8d47-630e487d5023 with identifier: VK01917
2026-03-30 09:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8edb7f5-cf65-5c08-8d47-630e487d5023 with scrape type 2
2026-03-30 09:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8edb7f5-cf65-5c08-8d47-630e487d5023 with scrape type 2
2026-03-30 09:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8edb7f5-cf65-5c08-8d47-630e487d5023, identifier: VK01917
2026-03-30 09:03:57 [auto1.it] INFO: Found listing with ID: MB21840
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB21840%27 HTTP/1.1" 200 None
2026-03-30 09:03:57 [auto1.it] INFO: Scrape type for MB21840: 2
2026-03-30 09:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a60a6e5-cf41-5659-b1a2-cc6af74fa9d6 with identifier: MB21840
2026-03-30 09:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a60a6e5-cf41-5659-b1a2-cc6af74fa9d6 with scrape type 2
2026-03-30 09:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a60a6e5-cf41-5659-b1a2-cc6af74fa9d6 with scrape type 2
2026-03-30 09:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0a60a6e5-cf41-5659-b1a2-cc6af74fa9d6, identifier: MB21840
2026-03-30 09:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_ebce7aa1f6a5367f54f3a302d93f799b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8edb7f5-cf65-5c08-8d47-630e487d5023 with identifier: VK01917
2026-03-30 09:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8edb7f5-cf65-5c08-8d47-630e487d5023 with identifier: VK01917
2026-03-30 09:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8edb7f5-cf65-5c08-8d47-630e487d5023 with identifier: VK01917 to the API
2026-03-30 09:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:22:19Z',
 'fuel_type': 'diesel',
 'id': 'd8edb7f5-cf65-5c08-8d47-630e487d5023',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK01917',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 49850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2016}
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK01917%27 HTTP/1.1" 200 None
2026-03-30 09:03:58 [auto1.it] INFO: Saving data for VK01917: {'auction_closing_time': 1774970539.0, 'created_time': 1773305033.945425, 'last_price_update_time': 1774861438.18295}
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VK01917') HTTP/1.1" 204 0
2026-03-30 09:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0a60a6e5-cf41-5659-b1a2-cc6af74fa9d6 with identifier: MB21840
2026-03-30 09:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0a60a6e5-cf41-5659-b1a2-cc6af74fa9d6 with identifier: MB21840
2026-03-30 09:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0a60a6e5-cf41-5659-b1a2-cc6af74fa9d6 with identifier: MB21840 to the API
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-31T15:40:11Z',
 'fuel_type': 'diesel',
 'id': '0a60a6e5-cf41-5659-b1a2-cc6af74fa9d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB21840',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 267596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-24',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB21840%27 HTTP/1.1" 200 None
2026-03-30 09:03:58 [auto1.it] INFO: Saving data for MB21840: {'auction_closing_time': 1774971611.0, 'created_time': 1774440060.164166, 'last_price_update_time': 1774861438.601352}
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MB21840') HTTP/1.1" 204 0
2026-03-30 09:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d03d90>
2026-03-30 09:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_9c84d03095e2c36a0969eaa76f3f602b.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_9c84d03095e2c36a0969eaa76f3f602b.jpg saved to cache
2026-03-30 09:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0066079f-1ba1-5322-810b-b31ff6e67689
2026-03-30 09:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0635a850>
2026-03-30 09:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F51%252Fad518d345edac97347367b6a73012b6d%252Fpa%252FHT52131_b2ec5701fced2fa0fbbd90d2a20f9dd5.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_b2ec5701fced2fa0fbbd90d2a20f9dd5.jpg saved to cache
2026-03-30 09:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0066079f-1ba1-5322-810b-b31ff6e67689
2026-03-30 09:03:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0066079f-1ba1-5322-810b-b31ff6e67689, skipping ID generation
2026-03-30 09:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0066079f-1ba1-5322-810b-b31ff6e67689 with scrape type 1
2026-03-30 09:03:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0066079f-1ba1-5322-810b-b31ff6e67689 sending to next pipeline
2026-03-30 09:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0066079f-1ba1-5322-810b-b31ff6e67689, identifier: HT52131
2026-03-30 09:03:58 [auto1.it] INFO: Found listing with ID: MJ72891
2026-03-30 09:03:58 [auto1.it] INFO: Found listing with ID: YX27089
2026-03-30 09:03:58 [auto1.it] INFO: Found listing with ID: CT16450
2026-03-30 09:03:58 [auto1.it] INFO: Found listing with ID: MH67906
2026-03-30 09:03:58 [auto1.it] INFO: Found listing with ID: BZ38599
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ38599%27 HTTP/1.1" 200 None
2026-03-30 09:03:58 [auto1.it] INFO: Scrape type for BZ38599: 2
2026-03-30 09:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98c87005-9928-5393-8773-df6316a9f72e with identifier: BZ38599
2026-03-30 09:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98c87005-9928-5393-8773-df6316a9f72e with scrape type 2
2026-03-30 09:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98c87005-9928-5393-8773-df6316a9f72e with scrape type 2
2026-03-30 09:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 98c87005-9928-5393-8773-df6316a9f72e, identifier: BZ38599
2026-03-30 09:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0066079f-1ba1-5322-810b-b31ff6e67689 with identifier: HT52131
2026-03-30 09:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0066079f-1ba1-5322-810b-b31ff6e67689 with identifier: HT52131
2026-03-30 09:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0066079f-1ba1-5322-810b-b31ff6e67689 with identifier: HT52131 to the API
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_b2ec5701fced2fa0fbbd90d2a20f9dd5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:50:13Z',
 'fuel_type': 'petrol',
 'id': '0066079f-1ba1-5322-810b-b31ff6e67689',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT52131',
 'listing': 'auction',
 'location': 'IT, Bologna',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 86105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2694044,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_6ff56f8c31b98153e4108cc8c0ad544f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652258,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_bdfdaf831a3bf168515737b87e76fb6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2585965,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_040ef793972fdffb0bb74db6f339f924.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2470793,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_80b9fbde16d092e6143b047cee5e9871.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2460255,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_b35865d427b83b4cfa8019111a962f31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2550556,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_06157016f748e0558fc07691fd2cc602.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2404737,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_b2ec5701fced2fa0fbbd90d2a20f9dd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2604196,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_9c84d03095e2c36a0969eaa76f3f602b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2678051,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_f76629dc093f48b382ca43ea57cf9c73.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0066079f-1ba1-5322-810b-b31ff6e67689/0066079f-1ba1-5322-810b-b31ff6e67689_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2670143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/51/ad518d345edac97347367b6a73012b6d/pa/HT52131_8f31f2a4d337c3afc00f0212734b40ae.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Login',
 'transmission': 'manual',
 'trim': 'Login',
 'year': 2017}
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT52131%27 HTTP/1.1" 200 None
2026-03-30 09:03:59 [auto1.it] INFO: Saving data for HT52131: {'created_time': 1774861439.460088, 'last_price_update_time': 1774861439.460098, 'auction_closing_time': 1774972213.0}
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HT52131') HTTP/1.1" 204 0
2026-03-30 09:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_a060104cc002b3148a63150f89af3ce8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 98c87005-9928-5393-8773-df6316a9f72e with identifier: BZ38599
2026-03-30 09:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 98c87005-9928-5393-8773-df6316a9f72e with identifier: BZ38599
2026-03-30 09:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 98c87005-9928-5393-8773-df6316a9f72e with identifier: BZ38599 to the API
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:05:03Z',
 'fuel_type': 'diesel',
 'id': '98c87005-9928-5393-8773-df6316a9f72e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ38599',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 188137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-30',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2013}
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ38599%27 HTTP/1.1" 200 None
2026-03-30 09:03:59 [auto1.it] INFO: Saving data for BZ38599: {'auction_closing_time': 1774969503.0, 'created_time': 1773954616.850238, 'last_price_update_time': 1774861439.775533}
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BZ38599') HTTP/1.1" 204 0
2026-03-30 09:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e5dc10>
2026-03-30 09:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_aa03cf1faf915b54c255e447b984d71f.jpg') HTTP/1.1" 204 0
2026-03-30 09:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_aa03cf1faf915b54c255e447b984d71f.jpg saved to cache
2026-03-30 09:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea036585-d06d-57db-92c9-a238b1e2a9ac
2026-03-30 09:03:59 [auto1.it] INFO: Found listing with ID: GR20661
2026-03-30 09:03:59 [auto1.it] INFO: Found listing with ID: BZ19379
2026-03-30 09:03:59 [auto1.it] INFO: Found listing with ID: MX71384
2026-03-30 09:03:59 [auto1.it] INFO: Found listing with ID: CZ45598
2026-03-30 09:03:59 [auto1.it] INFO: Found listing with ID: LL47627
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL47627%27 HTTP/1.1" 200 None
2026-03-30 09:03:59 [auto1.it] INFO: Scrape type for LL47627: 2
2026-03-30 09:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2967d42d-d713-5ad5-b57f-66fd1b77aa6d with identifier: LL47627
2026-03-30 09:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2967d42d-d713-5ad5-b57f-66fd1b77aa6d with scrape type 2
2026-03-30 09:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2967d42d-d713-5ad5-b57f-66fd1b77aa6d with scrape type 2
2026-03-30 09:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2967d42d-d713-5ad5-b57f-66fd1b77aa6d, identifier: LL47627
2026-03-30 09:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2967d42d-d713-5ad5-b57f-66fd1b77aa6d with identifier: LL47627
2026-03-30 09:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2967d42d-d713-5ad5-b57f-66fd1b77aa6d with identifier: LL47627
2026-03-30 09:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2967d42d-d713-5ad5-b57f-66fd1b77aa6d with identifier: LL47627 to the API
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:06:18Z',
 'fuel_type': 'diesel',
 'id': '2967d42d-d713-5ad5-b57f-66fd1b77aa6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL47627',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 187887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-26',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL47627%27 HTTP/1.1" 200 None
2026-03-30 09:04:00 [auto1.it] INFO: Saving data for LL47627: {'auction_closing_time': 1774969578.0, 'created_time': 1774645456.017077, 'last_price_update_time': 1774861440.430202}
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LL47627') HTTP/1.1" 204 0
2026-03-30 09:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c74b90>
2026-03-30 09:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915a2653-b8e1-5518-a3a7-f5cc0485b980/915a2653-b8e1-5518-a3a7-f5cc0485b980_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a898691cfa6e282f1bf2edc094ac1d%252Fpa%252FXR25970_ebce7aa1f6a5367f54f3a302d93f799b.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_ebce7aa1f6a5367f54f3a302d93f799b.jpg saved to cache
2026-03-30 09:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 915a2653-b8e1-5518-a3a7-f5cc0485b980
2026-03-30 09:04:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 915a2653-b8e1-5518-a3a7-f5cc0485b980, skipping ID generation
2026-03-30 09:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915a2653-b8e1-5518-a3a7-f5cc0485b980 with scrape type 1
2026-03-30 09:04:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 915a2653-b8e1-5518-a3a7-f5cc0485b980 sending to next pipeline
2026-03-30 09:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 915a2653-b8e1-5518-a3a7-f5cc0485b980, identifier: XR25970
2026-03-30 09:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_9941a50215932b4ff30c344692f0a417.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_74f24b6e557fca67e7fb8083182f10ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:00 [auto1.it] INFO: Found listing with ID: JF46642
2026-03-30 09:04:00 [auto1.it] INFO: Found listing with ID: GZ96497
2026-03-30 09:04:00 [auto1.it] INFO: Found listing with ID: MA97320
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA97320%27 HTTP/1.1" 200 None
2026-03-30 09:04:00 [auto1.it] INFO: Scrape type for MA97320: 1
2026-03-30 09:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 915a2653-b8e1-5518-a3a7-f5cc0485b980 with identifier: XR25970
2026-03-30 09:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 915a2653-b8e1-5518-a3a7-f5cc0485b980 with identifier: XR25970
2026-03-30 09:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 915a2653-b8e1-5518-a3a7-f5cc0485b980 with identifier: XR25970 to the API
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_ebce7aa1f6a5367f54f3a302d93f799b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 77,
 'expiration_date': '2026-03-31T15:17:51Z',
 'fuel_type': 'petrol',
 'id': '915a2653-b8e1-5518-a3a7-f5cc0485b980',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR25970',
 'listing': 'auction',
 'location': 'IT, Lallio BG',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 220479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915a2653-b8e1-5518-a3a7-f5cc0485b980/915a2653-b8e1-5518-a3a7-f5cc0485b980_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_10923428ed5d73fd283a7eb89cc254f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915a2653-b8e1-5518-a3a7-f5cc0485b980/915a2653-b8e1-5518-a3a7-f5cc0485b980_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_9b7c30ec9b85069a80a19287d8df95ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915a2653-b8e1-5518-a3a7-f5cc0485b980/915a2653-b8e1-5518-a3a7-f5cc0485b980_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_74986774c38f85522d5cfa4f9db80905.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915a2653-b8e1-5518-a3a7-f5cc0485b980/915a2653-b8e1-5518-a3a7-f5cc0485b980_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_ebce7aa1f6a5367f54f3a302d93f799b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915a2653-b8e1-5518-a3a7-f5cc0485b980/915a2653-b8e1-5518-a3a7-f5cc0485b980_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a898691cfa6e282f1bf2edc094ac1d/pa/XR25970_63bfd0520f43b96eae19ba5571c804f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2009}
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR25970%27 HTTP/1.1" 200 None
2026-03-30 09:04:01 [auto1.it] INFO: Saving data for XR25970: {'created_time': 1774861441.274989, 'last_price_update_time': 1774861441.275003, 'auction_closing_time': 1774970271.0}
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XR25970') HTTP/1.1" 204 0
2026-03-30 09:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_b83179096ff35e2d6691426629e98aa6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:01 [auto1.it] INFO: Found listing with ID: SU50076
2026-03-30 09:04:01 [auto1.it] INFO: Found listing with ID: PM97583
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM97583%27 HTTP/1.1" 200 None
2026-03-30 09:04:01 [auto1.it] INFO: Scrape type for PM97583: 2
2026-03-30 09:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0a45706-bbd5-5858-86ba-4b7284e4a7de with identifier: PM97583
2026-03-30 09:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0a45706-bbd5-5858-86ba-4b7284e4a7de with scrape type 2
2026-03-30 09:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0a45706-bbd5-5858-86ba-4b7284e4a7de with scrape type 2
2026-03-30 09:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d0a45706-bbd5-5858-86ba-4b7284e4a7de, identifier: PM97583
2026-03-30 09:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0619e410>
2026-03-30 09:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b5115d-0763-5fa7-9224-5ab626f7aed2/c6b5115d-0763-5fa7-9224-5ab626f7aed2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc4%252F5bc49a628e55b53fa9fa9543d4c00524%252Fpa%252FSV41912_a060104cc002b3148a63150f89af3ce8.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_a060104cc002b3148a63150f89af3ce8.jpg saved to cache
2026-03-30 09:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6b5115d-0763-5fa7-9224-5ab626f7aed2
2026-03-30 09:04:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6b5115d-0763-5fa7-9224-5ab626f7aed2, skipping ID generation
2026-03-30 09:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6b5115d-0763-5fa7-9224-5ab626f7aed2 with scrape type 1
2026-03-30 09:04:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6b5115d-0763-5fa7-9224-5ab626f7aed2 sending to next pipeline
2026-03-30 09:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c6b5115d-0763-5fa7-9224-5ab626f7aed2, identifier: SV41912
2026-03-30 09:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d0a45706-bbd5-5858-86ba-4b7284e4a7de with identifier: PM97583
2026-03-30 09:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d0a45706-bbd5-5858-86ba-4b7284e4a7de with identifier: PM97583
2026-03-30 09:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d0a45706-bbd5-5858-86ba-4b7284e4a7de with identifier: PM97583 to the API
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:47:36Z',
 'fuel_type': 'diesel',
 'id': 'd0a45706-bbd5-5858-86ba-4b7284e4a7de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM97583',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 123689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-21',
 'seller_name': None,
 'title': 'MINI Countryman Cooper SD ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2014}
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM97583%27 HTTP/1.1" 200 None
2026-03-30 09:04:01 [auto1.it] INFO: Saving data for PM97583: {'auction_closing_time': 1774972056.0, 'created_time': 1774386140.268776, 'last_price_update_time': 1774861441.957017}
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM97583') HTTP/1.1" 204 0
2026-03-30 09:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c6b5115d-0763-5fa7-9224-5ab626f7aed2 with identifier: SV41912
2026-03-30 09:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c6b5115d-0763-5fa7-9224-5ab626f7aed2 with identifier: SV41912
2026-03-30 09:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c6b5115d-0763-5fa7-9224-5ab626f7aed2 with identifier: SV41912 to the API
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_a060104cc002b3148a63150f89af3ce8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:47:02Z',
 'fuel_type': 'petrol',
 'id': 'c6b5115d-0763-5fa7-9224-5ab626f7aed2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV41912',
 'listing': 'auction',
 'location': 'IT, Messina',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 151468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b5115d-0763-5fa7-9224-5ab626f7aed2/c6b5115d-0763-5fa7-9224-5ab626f7aed2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_8f2401bbdcb07777d5aff90bc8d3ec39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b5115d-0763-5fa7-9224-5ab626f7aed2/c6b5115d-0763-5fa7-9224-5ab626f7aed2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_a060104cc002b3148a63150f89af3ce8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b5115d-0763-5fa7-9224-5ab626f7aed2/c6b5115d-0763-5fa7-9224-5ab626f7aed2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_3008aa2b4b943c52ff0b5194110ba55a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b5115d-0763-5fa7-9224-5ab626f7aed2/c6b5115d-0763-5fa7-9224-5ab626f7aed2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_d8ebf823ba405d262927b54c1aa0ac43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b5115d-0763-5fa7-9224-5ab626f7aed2/c6b5115d-0763-5fa7-9224-5ab626f7aed2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_9c3d274480fe9e8ddc5cbc5fd3424587.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b5115d-0763-5fa7-9224-5ab626f7aed2/c6b5115d-0763-5fa7-9224-5ab626f7aed2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c4/5bc49a628e55b53fa9fa9543d4c00524/pa/SV41912_f7950747e783e12b2aee9c919bb73e83.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV41912%27 HTTP/1.1" 200 None
2026-03-30 09:04:02 [auto1.it] INFO: Saving data for SV41912: {'created_time': 1774861442.385051, 'last_price_update_time': 1774861442.385062, 'auction_closing_time': 1774972022.0}
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SV41912') HTTP/1.1" 204 0
2026-03-30 09:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_c2412be36411d7ef1a5a592988712c71.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:02 [auto1.it] INFO: Found listing with ID: KA09698
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA09698%27 HTTP/1.1" 200 None
2026-03-30 09:04:02 [auto1.it] INFO: Scrape type for KA09698: 2
2026-03-30 09:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14e623e9-ee5f-53ee-8c77-22c1e0ec9b7d with identifier: KA09698
2026-03-30 09:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14e623e9-ee5f-53ee-8c77-22c1e0ec9b7d with scrape type 2
2026-03-30 09:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14e623e9-ee5f-53ee-8c77-22c1e0ec9b7d with scrape type 2
2026-03-30 09:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 14e623e9-ee5f-53ee-8c77-22c1e0ec9b7d, identifier: KA09698
2026-03-30 09:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063fa190>
2026-03-30 09:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_9941a50215932b4ff30c344692f0a417.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_9941a50215932b4ff30c344692f0a417.jpg saved to cache
2026-03-30 09:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea036585-d06d-57db-92c9-a238b1e2a9ac
2026-03-30 09:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0619ba90>
2026-03-30 09:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_74f24b6e557fca67e7fb8083182f10ae.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_74f24b6e557fca67e7fb8083182f10ae.jpg saved to cache
2026-03-30 09:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a09fef4-293c-58e9-a9a3-caec9861a249
2026-03-30 09:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_25e03d2cbf2517e1e47ca43009d5dd3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 14e623e9-ee5f-53ee-8c77-22c1e0ec9b7d with identifier: KA09698
2026-03-30 09:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 14e623e9-ee5f-53ee-8c77-22c1e0ec9b7d with identifier: KA09698
2026-03-30 09:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 14e623e9-ee5f-53ee-8c77-22c1e0ec9b7d with identifier: KA09698 to the API
2026-03-30 09:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:47:56Z',
 'fuel_type': 'diesel',
 'id': '14e623e9-ee5f-53ee-8c77-22c1e0ec9b7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA09698',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 242936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-19',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTD Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2018}
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA09698%27 HTTP/1.1" 200 None
2026-03-30 09:04:03 [auto1.it] INFO: Saving data for KA09698: {'auction_closing_time': 1774972076.0, 'created_time': 1773231064.263007, 'last_price_update_time': 1774861443.216035}
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KA09698') HTTP/1.1" 204 0
2026-03-30 09:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_4efb232a64198da00ec7fc3d839dadf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_d1e308787f1e936ceb9f58a3becc4d92.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:03 [auto1.it] INFO: Found listing with ID: BF97905
2026-03-30 09:04:03 [auto1.it] INFO: Found listing with ID: UX20076
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX20076%27 HTTP/1.1" 200 None
2026-03-30 09:04:03 [auto1.it] INFO: Scrape type for UX20076: 2
2026-03-30 09:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c3f1333-cb6a-5d98-8571-fe3948e3b1af with identifier: UX20076
2026-03-30 09:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c3f1333-cb6a-5d98-8571-fe3948e3b1af with scrape type 2
2026-03-30 09:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c3f1333-cb6a-5d98-8571-fe3948e3b1af with scrape type 2
2026-03-30 09:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c3f1333-cb6a-5d98-8571-fe3948e3b1af, identifier: UX20076
2026-03-30 09:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d00250>
2026-03-30 09:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae697335-c958-5640-a518-79ef8caeeb3e/ae697335-c958-5640-a518-79ef8caeeb3e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa1%252Fada1f4a89f11059afd8f8668970896c6%252Fpa%252FPN24411_b83179096ff35e2d6691426629e98aa6.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_b83179096ff35e2d6691426629e98aa6.jpg saved to cache
2026-03-30 09:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae697335-c958-5640-a518-79ef8caeeb3e
2026-03-30 09:04:03 [auto1.it] INFO: Channel: 24h | Page: 17 | totalHits: 3300 | hits on page: 40
2026-03-30 09:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c3f1333-cb6a-5d98-8571-fe3948e3b1af with identifier: UX20076
2026-03-30 09:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c3f1333-cb6a-5d98-8571-fe3948e3b1af with identifier: UX20076
2026-03-30 09:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c3f1333-cb6a-5d98-8571-fe3948e3b1af with identifier: UX20076 to the API
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-31T15:14:46Z',
 'fuel_type': 'petrol',
 'id': '6c3f1333-cb6a-5d98-8571-fe3948e3b1af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX20076',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 95106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-22',
 'seller_name': None,
 'title': 'Fiat Panda 1.1 Van 2 Sitze',
 'transmission': 'manual',
 'trim': 'Van 2 Sitze',
 'year': 2009}
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX20076%27 HTTP/1.1" 200 None
2026-03-30 09:04:03 [auto1.it] INFO: Saving data for UX20076: {'auction_closing_time': 1774970086.0, 'created_time': 1774015452.797677, 'last_price_update_time': 1774861443.719051}
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UX20076') HTTP/1.1" 204 0
2026-03-30 09:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:03 [auto1.it] INFO: Found listing with ID: KK34304
2026-03-30 09:04:03 [auto1.it] INFO: Found listing with ID: XM71066
2026-03-30 09:04:03 [auto1.it] INFO: Found listing with ID: BU32939
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU32939%27 HTTP/1.1" 200 None
2026-03-30 09:04:03 [auto1.it] INFO: Scrape type for BU32939: 2
2026-03-30 09:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c4f5ac-fe33-5f79-aaa3-d9f2d7383674 with identifier: BU32939
2026-03-30 09:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c4f5ac-fe33-5f79-aaa3-d9f2d7383674 with scrape type 2
2026-03-30 09:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6c4f5ac-fe33-5f79-aaa3-d9f2d7383674 with scrape type 2
2026-03-30 09:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e6c4f5ac-fe33-5f79-aaa3-d9f2d7383674, identifier: BU32939
2026-03-30 09:04:03 [auto1.it] INFO: Found listing with ID: PZ68086
2026-03-30 09:04:03 [auto1.it] INFO: Found listing with ID: UT61687
2026-03-30 09:04:03 [auto1.it] INFO: Found listing with ID: ZY19539
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY19539%27 HTTP/1.1" 200 None
2026-03-30 09:04:03 [auto1.it] INFO: Scrape type for ZY19539: 2
2026-03-30 09:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5235d349-5406-53ad-881e-de336d19ed71 with identifier: ZY19539
2026-03-30 09:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5235d349-5406-53ad-881e-de336d19ed71 with scrape type 2
2026-03-30 09:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5235d349-5406-53ad-881e-de336d19ed71 with scrape type 2
2026-03-30 09:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5235d349-5406-53ad-881e-de336d19ed71, identifier: ZY19539
2026-03-30 09:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e6c4f5ac-fe33-5f79-aaa3-d9f2d7383674 with identifier: BU32939
2026-03-30 09:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e6c4f5ac-fe33-5f79-aaa3-d9f2d7383674 with identifier: BU32939
2026-03-30 09:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e6c4f5ac-fe33-5f79-aaa3-d9f2d7383674 with identifier: BU32939 to the API
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:29:11Z',
 'fuel_type': 'electro',
 'id': 'e6c4f5ac-fe33-5f79-aaa3-d9f2d7383674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU32939',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane E-Tech',
 'odometer': 71837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-03',
 'seller_name': None,
 'title': 'Renault Megane E-Tech EV60 Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2022}
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU32939%27 HTTP/1.1" 200 None
2026-03-30 09:04:04 [auto1.it] INFO: Saving data for BU32939: {'auction_closing_time': 1774970951.0, 'created_time': 1773910940.790143, 'last_price_update_time': 1774861444.336829}
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BU32939') HTTP/1.1" 204 0
2026-03-30 09:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5235d349-5406-53ad-881e-de336d19ed71 with identifier: ZY19539
2026-03-30 09:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5235d349-5406-53ad-881e-de336d19ed71 with identifier: ZY19539
2026-03-30 09:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5235d349-5406-53ad-881e-de336d19ed71 with identifier: ZY19539 to the API
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:52:50Z',
 'fuel_type': 'petrol',
 'id': '5235d349-5406-53ad-881e-de336d19ed71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY19539',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 96512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-27',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY19539%27 HTTP/1.1" 200 None
2026-03-30 09:04:04 [auto1.it] INFO: Saving data for ZY19539: {'auction_closing_time': 1774972370.0, 'created_time': 1773954591.561072, 'last_price_update_time': 1774861444.776862}
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZY19539') HTTP/1.1" 204 0
2026-03-30 09:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c54350>
2026-03-30 09:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae697335-c958-5640-a518-79ef8caeeb3e/ae697335-c958-5640-a518-79ef8caeeb3e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa1%252Fada1f4a89f11059afd8f8668970896c6%252Fpa%252FPN24411_c2412be36411d7ef1a5a592988712c71.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_c2412be36411d7ef1a5a592988712c71.jpg saved to cache
2026-03-30 09:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae697335-c958-5640-a518-79ef8caeeb3e
2026-03-30 09:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062bc7d0>
2026-03-30 09:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae697335-c958-5640-a518-79ef8caeeb3e/ae697335-c958-5640-a518-79ef8caeeb3e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa1%252Fada1f4a89f11059afd8f8668970896c6%252Fpa%252FPN24411_25e03d2cbf2517e1e47ca43009d5dd3d.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_25e03d2cbf2517e1e47ca43009d5dd3d.jpg saved to cache
2026-03-30 09:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae697335-c958-5640-a518-79ef8caeeb3e
2026-03-30 09:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061bffd0>
2026-03-30 09:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_4efb232a64198da00ec7fc3d839dadf3.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_4efb232a64198da00ec7fc3d839dadf3.jpg saved to cache
2026-03-30 09:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a09fef4-293c-58e9-a9a3-caec9861a249
2026-03-30 09:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ca7d10>
2026-03-30 09:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae697335-c958-5640-a518-79ef8caeeb3e/ae697335-c958-5640-a518-79ef8caeeb3e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa1%252Fada1f4a89f11059afd8f8668970896c6%252Fpa%252FPN24411_d1e308787f1e936ceb9f58a3becc4d92.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_d1e308787f1e936ceb9f58a3becc4d92.jpg saved to cache
2026-03-30 09:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae697335-c958-5640-a518-79ef8caeeb3e
2026-03-30 09:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_2d850ab8c51c5159ba0685cecc4f61ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_6d26d27b19aac9089aae840790ef088b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:05 [auto1.it] INFO: Found listing with ID: ZF50990
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF50990%27 HTTP/1.1" 200 None
2026-03-30 09:04:05 [auto1.it] INFO: Scrape type for ZF50990: 2
2026-03-30 09:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7f929bc-852b-5d06-8d3e-d4a29cb06193 with identifier: ZF50990
2026-03-30 09:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7f929bc-852b-5d06-8d3e-d4a29cb06193 with scrape type 2
2026-03-30 09:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7f929bc-852b-5d06-8d3e-d4a29cb06193 with scrape type 2
2026-03-30 09:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c7f929bc-852b-5d06-8d3e-d4a29cb06193, identifier: ZF50990
2026-03-30 09:04:05 [auto1.it] INFO: Found listing with ID: ZH83607
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH83607%27 HTTP/1.1" 200 None
2026-03-30 09:04:05 [auto1.it] INFO: Scrape type for ZH83607: 2
2026-03-30 09:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10048d81-12a5-532e-a182-27f42ce17b63 with identifier: ZH83607
2026-03-30 09:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10048d81-12a5-532e-a182-27f42ce17b63 with scrape type 2
2026-03-30 09:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10048d81-12a5-532e-a182-27f42ce17b63 with scrape type 2
2026-03-30 09:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 10048d81-12a5-532e-a182-27f42ce17b63, identifier: ZH83607
2026-03-30 09:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_51899ec672d5a71fab9b0865612f5eac.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:05 [scrapy.extensions.logstats] INFO: Crawled 155 pages (at 16 pages/min), scraped 277 items (at 85 items/min)
2026-03-30 09:04:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 197MiB
2026-03-30 09:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c7f929bc-852b-5d06-8d3e-d4a29cb06193 with identifier: ZF50990
2026-03-30 09:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c7f929bc-852b-5d06-8d3e-d4a29cb06193 with identifier: ZF50990
2026-03-30 09:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c7f929bc-852b-5d06-8d3e-d4a29cb06193 with identifier: ZF50990 to the API
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:19:08Z',
 'fuel_type': 'petrol',
 'id': 'c7f929bc-852b-5d06-8d3e-d4a29cb06193',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF50990',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 356703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-30',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turbo BlackLine',
 'transmission': 'manual',
 'trim': 'BlackLine',
 'year': 2011}
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF50990%27 HTTP/1.1" 200 None
2026-03-30 09:04:05 [auto1.it] INFO: Saving data for ZF50990: {'auction_closing_time': 1774970348.0, 'created_time': 1773270381.464953, 'last_price_update_time': 1774861445.712579}
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZF50990') HTTP/1.1" 204 0
2026-03-30 09:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 10048d81-12a5-532e-a182-27f42ce17b63 with identifier: ZH83607
2026-03-30 09:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 10048d81-12a5-532e-a182-27f42ce17b63 with identifier: ZH83607
2026-03-30 09:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 10048d81-12a5-532e-a182-27f42ce17b63 with identifier: ZH83607 to the API
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:32:51Z',
 'fuel_type': 'diesel',
 'id': '10048d81-12a5-532e-a182-27f42ce17b63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH83607',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 261844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-21',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI quattro Ambiente',
 'transmission': 'manual',
 'trim': 'quattro Ambiente',
 'year': 2013}
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH83607%27 HTTP/1.1" 200 None
2026-03-30 09:04:06 [auto1.it] INFO: Saving data for ZH83607: {'auction_closing_time': 1774971171.0, 'created_time': 1773522186.864401, 'last_price_update_time': 1774861446.050495}
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH83607') HTTP/1.1" 204 0
2026-03-30 09:04:06 [auto1.it] INFO: Found listing with ID: YV30148
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV30148%27 HTTP/1.1" 200 None
2026-03-30 09:04:06 [auto1.it] INFO: Scrape type for YV30148: 2
2026-03-30 09:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa6a7c94-79e4-5d68-ac94-a8583baa1fef with identifier: YV30148
2026-03-30 09:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa6a7c94-79e4-5d68-ac94-a8583baa1fef with scrape type 2
2026-03-30 09:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa6a7c94-79e4-5d68-ac94-a8583baa1fef with scrape type 2
2026-03-30 09:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aa6a7c94-79e4-5d68-ac94-a8583baa1fef, identifier: YV30148
2026-03-30 09:04:06 [auto1.it] INFO: Found listing with ID: GW68034
2026-03-30 09:04:06 [auto1.it] INFO: Found listing with ID: DM89390
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM89390%27 HTTP/1.1" 200 None
2026-03-30 09:04:06 [auto1.it] INFO: Scrape type for DM89390: 2
2026-03-30 09:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7752c549-4425-515b-a28c-d6b0fec4e6f6 with identifier: DM89390
2026-03-30 09:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7752c549-4425-515b-a28c-d6b0fec4e6f6 with scrape type 2
2026-03-30 09:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7752c549-4425-515b-a28c-d6b0fec4e6f6 with scrape type 2
2026-03-30 09:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7752c549-4425-515b-a28c-d6b0fec4e6f6, identifier: DM89390
2026-03-30 09:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aa6a7c94-79e4-5d68-ac94-a8583baa1fef with identifier: YV30148
2026-03-30 09:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aa6a7c94-79e4-5d68-ac94-a8583baa1fef with identifier: YV30148
2026-03-30 09:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aa6a7c94-79e4-5d68-ac94-a8583baa1fef with identifier: YV30148 to the API
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:36:12Z',
 'fuel_type': 'diesel',
 'id': 'aa6a7c94-79e4-5d68-ac94-a8583baa1fef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV30148',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 215397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 e-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2014}
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV30148%27 HTTP/1.1" 200 None
2026-03-30 09:04:06 [auto1.it] INFO: Saving data for YV30148: {'auction_closing_time': 1774971372.0, 'created_time': 1774386204.676064, 'last_price_update_time': 1774861446.659069}
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YV30148') HTTP/1.1" 204 0
2026-03-30 09:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7752c549-4425-515b-a28c-d6b0fec4e6f6 with identifier: DM89390
2026-03-30 09:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7752c549-4425-515b-a28c-d6b0fec4e6f6 with identifier: DM89390
2026-03-30 09:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7752c549-4425-515b-a28c-d6b0fec4e6f6 with identifier: DM89390 to the API
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:19:54Z',
 'fuel_type': 'petrol',
 'id': '7752c549-4425-515b-a28c-d6b0fec4e6f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM89390',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 116854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-13',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Monte Carlo',
 'transmission': 'manual',
 'trim': 'Monte Carlo',
 'year': 2013}
2026-03-30 09:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM89390%27 HTTP/1.1" 200 None
2026-03-30 09:04:07 [auto1.it] INFO: Saving data for DM89390: {'auction_closing_time': 1774970394.0, 'created_time': 1773867822.339156, 'last_price_update_time': 1774861447.008263}
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DM89390') HTTP/1.1" 204 0
2026-03-30 09:04:07 [auto1.it] INFO: Found listing with ID: NY67397
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY67397%27 HTTP/1.1" 200 None
2026-03-30 09:04:07 [auto1.it] INFO: Scrape type for NY67397: 2
2026-03-30 09:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c0989d1-3d9e-55c7-8810-c64623351a7b with identifier: NY67397
2026-03-30 09:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0989d1-3d9e-55c7-8810-c64623351a7b with scrape type 2
2026-03-30 09:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c0989d1-3d9e-55c7-8810-c64623351a7b with scrape type 2
2026-03-30 09:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c0989d1-3d9e-55c7-8810-c64623351a7b, identifier: NY67397
2026-03-30 09:04:07 [auto1.it] INFO: Found listing with ID: BX66797
2026-03-30 09:04:07 [auto1.it] INFO: Found listing with ID: UL03529
2026-03-30 09:04:07 [auto1.it] INFO: Found listing with ID: TJ83319
2026-03-30 09:04:07 [auto1.it] INFO: Found listing with ID: EX36088
2026-03-30 09:04:07 [auto1.it] INFO: Found listing with ID: EY09405
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY09405%27 HTTP/1.1" 200 None
2026-03-30 09:04:07 [auto1.it] INFO: Scrape type for EY09405: 2
2026-03-30 09:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8eda2fe-f9e2-591f-8817-a0bb64ff4f18 with identifier: EY09405
2026-03-30 09:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8eda2fe-f9e2-591f-8817-a0bb64ff4f18 with scrape type 2
2026-03-30 09:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8eda2fe-f9e2-591f-8817-a0bb64ff4f18 with scrape type 2
2026-03-30 09:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c8eda2fe-f9e2-591f-8817-a0bb64ff4f18, identifier: EY09405
2026-03-30 09:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0622e190>
2026-03-30 09:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_2d850ab8c51c5159ba0685cecc4f61ce.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_2d850ab8c51c5159ba0685cecc4f61ce.jpg saved to cache
2026-03-30 09:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a09fef4-293c-58e9-a9a3-caec9861a249
2026-03-30 09:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062bea10>
2026-03-30 09:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae697335-c958-5640-a518-79ef8caeeb3e/ae697335-c958-5640-a518-79ef8caeeb3e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa1%252Fada1f4a89f11059afd8f8668970896c6%252Fpa%252FPN24411_6d26d27b19aac9089aae840790ef088b.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_6d26d27b19aac9089aae840790ef088b.jpg saved to cache
2026-03-30 09:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae697335-c958-5640-a518-79ef8caeeb3e
2026-03-30 09:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c10110>
2026-03-30 09:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_51899ec672d5a71fab9b0865612f5eac.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_51899ec672d5a71fab9b0865612f5eac.jpg saved to cache
2026-03-30 09:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a09fef4-293c-58e9-a9a3-caec9861a249
2026-03-30 09:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_17d6be8d03b1346c3422e57510a1d26e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c0989d1-3d9e-55c7-8810-c64623351a7b with identifier: NY67397
2026-03-30 09:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c0989d1-3d9e-55c7-8810-c64623351a7b with identifier: NY67397
2026-03-30 09:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c0989d1-3d9e-55c7-8810-c64623351a7b with identifier: NY67397 to the API
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:06:35Z',
 'fuel_type': 'diesel',
 'id': '3c0989d1-3d9e-55c7-8810-c64623351a7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY67397',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 325856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 250 CDI 4Matic BlueTec',
 'transmission': 'automatic',
 'trim': '4Matic BlueTec',
 'year': 2014}
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY67397%27 HTTP/1.1" 200 None
2026-03-30 09:04:07 [auto1.it] INFO: Saving data for NY67397: {'auction_closing_time': 1774969595.0, 'created_time': 1774440036.137928, 'last_price_update_time': 1774861447.880907}
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NY67397') HTTP/1.1" 204 0
2026-03-30 09:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c8eda2fe-f9e2-591f-8817-a0bb64ff4f18 with identifier: EY09405
2026-03-30 09:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c8eda2fe-f9e2-591f-8817-a0bb64ff4f18 with identifier: EY09405
2026-03-30 09:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c8eda2fe-f9e2-591f-8817-a0bb64ff4f18 with identifier: EY09405 to the API
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-31T15:20:40Z',
 'fuel_type': 'petrol',
 'id': 'c8eda2fe-f9e2-591f-8817-a0bb64ff4f18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY09405',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 146087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-31',
 'seller_name': None,
 'title': 'MINI Countryman One',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY09405%27 HTTP/1.1" 200 None
2026-03-30 09:04:08 [auto1.it] INFO: Saving data for EY09405: {'auction_closing_time': 1774970440.0, 'created_time': 1773327888.384575, 'last_price_update_time': 1774861448.329101}
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EY09405') HTTP/1.1" 204 0
2026-03-30 09:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA97320/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:08 [auto1.it] INFO: Found listing with ID: VM52207
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM52207%27 HTTP/1.1" 200 None
2026-03-30 09:04:08 [auto1.it] INFO: Scrape type for VM52207: 2
2026-03-30 09:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d05e9907-4a50-5dca-90e4-be7e9e42e61a with identifier: VM52207
2026-03-30 09:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d05e9907-4a50-5dca-90e4-be7e9e42e61a with scrape type 2
2026-03-30 09:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d05e9907-4a50-5dca-90e4-be7e9e42e61a with scrape type 2
2026-03-30 09:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d05e9907-4a50-5dca-90e4-be7e9e42e61a, identifier: VM52207
2026-03-30 09:04:08 [auto1.it] INFO: Found listing with ID: EV42289
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV42289%27 HTTP/1.1" 200 None
2026-03-30 09:04:08 [auto1.it] INFO: Scrape type for EV42289: 2
2026-03-30 09:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09457c94-9cef-5f68-bd43-e905492d2aa3 with identifier: EV42289
2026-03-30 09:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09457c94-9cef-5f68-bd43-e905492d2aa3 with scrape type 2
2026-03-30 09:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09457c94-9cef-5f68-bd43-e905492d2aa3 with scrape type 2
2026-03-30 09:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 09457c94-9cef-5f68-bd43-e905492d2aa3, identifier: EV42289
2026-03-30 09:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d05e9907-4a50-5dca-90e4-be7e9e42e61a with identifier: VM52207
2026-03-30 09:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d05e9907-4a50-5dca-90e4-be7e9e42e61a with identifier: VM52207
2026-03-30 09:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d05e9907-4a50-5dca-90e4-be7e9e42e61a with identifier: VM52207 to the API
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:14:29Z',
 'fuel_type': 'diesel',
 'id': 'd05e9907-4a50-5dca-90e4-be7e9e42e61a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM52207',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 200506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-26',
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2016}
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM52207%27 HTTP/1.1" 200 None
2026-03-30 09:04:08 [auto1.it] INFO: Saving data for VM52207: {'auction_closing_time': 1774970069.0, 'created_time': 1774472610.350408, 'last_price_update_time': 1774861448.98114}
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VM52207') HTTP/1.1" 204 0
2026-03-30 09:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 09457c94-9cef-5f68-bd43-e905492d2aa3 with identifier: EV42289
2026-03-30 09:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 09457c94-9cef-5f68-bd43-e905492d2aa3 with identifier: EV42289
2026-03-30 09:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 09457c94-9cef-5f68-bd43-e905492d2aa3 with identifier: EV42289 to the API
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:58:30Z',
 'fuel_type': 'diesel',
 'id': '09457c94-9cef-5f68-bd43-e905492d2aa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV42289',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 224906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-07',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid 320 L1 Tourneo Titanium X',
 'transmission': 'manual',
 'trim': '320 L1 Tourneo Titanium X',
 'year': 2020}
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV42289%27 HTTP/1.1" 200 None
2026-03-30 09:04:09 [auto1.it] INFO: Saving data for EV42289: {'auction_closing_time': 1774972710.0, 'created_time': 1774440060.576935, 'last_price_update_time': 1774861449.378111}
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EV42289') HTTP/1.1" 204 0
2026-03-30 09:04:09 [auto1.it] INFO: Found listing with ID: GR99971
2026-03-30 09:04:09 [auto1.it] INFO: Found listing with ID: ZZ58047
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ58047%27 HTTP/1.1" 200 None
2026-03-30 09:04:09 [auto1.it] INFO: Scrape type for ZZ58047: 1
2026-03-30 09:04:09 [auto1.it] INFO: Found listing with ID: KC61332
2026-03-30 09:04:09 [auto1.it] INFO: Found listing with ID: DF99312
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF99312%27 HTTP/1.1" 200 None
2026-03-30 09:04:09 [auto1.it] INFO: Scrape type for DF99312: 1
2026-03-30 09:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d80690>
2026-03-30 09:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae697335-c958-5640-a518-79ef8caeeb3e/ae697335-c958-5640-a518-79ef8caeeb3e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa1%252Fada1f4a89f11059afd8f8668970896c6%252Fpa%252FPN24411_17d6be8d03b1346c3422e57510a1d26e.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_17d6be8d03b1346c3422e57510a1d26e.jpg saved to cache
2026-03-30 09:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae697335-c958-5640-a518-79ef8caeeb3e
2026-03-30 09:04:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae697335-c958-5640-a518-79ef8caeeb3e, skipping ID generation
2026-03-30 09:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae697335-c958-5640-a518-79ef8caeeb3e with scrape type 1
2026-03-30 09:04:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae697335-c958-5640-a518-79ef8caeeb3e sending to next pipeline
2026-03-30 09:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ae697335-c958-5640-a518-79ef8caeeb3e, identifier: PN24411
2026-03-30 09:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_43682b3fee23ed9a5dec83a275454d8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:09 [auto1.it] INFO: Found listing with ID: PZ68086
2026-03-30 09:04:09 [auto1.it] INFO: Found listing with ID: UT61687
2026-03-30 09:04:09 [auto1.it] INFO: Found listing with ID: ZY19539
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY19539%27 HTTP/1.1" 200 None
2026-03-30 09:04:09 [auto1.it] INFO: Scrape type for ZY19539: 0
2026-03-30 09:04:09 [auto1.it] INFO: Found listing with ID: GJ96809
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ96809%27 HTTP/1.1" 200 None
2026-03-30 09:04:09 [auto1.it] INFO: Scrape type for GJ96809: 2
2026-03-30 09:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c157b97d-0b51-5aaf-9901-95bc02198711 with identifier: GJ96809
2026-03-30 09:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c157b97d-0b51-5aaf-9901-95bc02198711 with scrape type 2
2026-03-30 09:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c157b97d-0b51-5aaf-9901-95bc02198711 with scrape type 2
2026-03-30 09:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c157b97d-0b51-5aaf-9901-95bc02198711, identifier: GJ96809
2026-03-30 09:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA72760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM60630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ae697335-c958-5640-a518-79ef8caeeb3e with identifier: PN24411
2026-03-30 09:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ae697335-c958-5640-a518-79ef8caeeb3e with identifier: PN24411
2026-03-30 09:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ae697335-c958-5640-a518-79ef8caeeb3e with identifier: PN24411 to the API
2026-03-30 09:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_17d6be8d03b1346c3422e57510a1d26e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:10:25Z',
 'fuel_type': 'petrol',
 'id': 'ae697335-c958-5640-a518-79ef8caeeb3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN24411',
 'listing': 'auction',
 'location': 'IT, Bologna',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 115629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae697335-c958-5640-a518-79ef8caeeb3e/ae697335-c958-5640-a518-79ef8caeeb3e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_17d6be8d03b1346c3422e57510a1d26e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae697335-c958-5640-a518-79ef8caeeb3e/ae697335-c958-5640-a518-79ef8caeeb3e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_b83179096ff35e2d6691426629e98aa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae697335-c958-5640-a518-79ef8caeeb3e/ae697335-c958-5640-a518-79ef8caeeb3e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_6d26d27b19aac9089aae840790ef088b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae697335-c958-5640-a518-79ef8caeeb3e/ae697335-c958-5640-a518-79ef8caeeb3e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_d1e308787f1e936ceb9f58a3becc4d92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae697335-c958-5640-a518-79ef8caeeb3e/ae697335-c958-5640-a518-79ef8caeeb3e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_c2412be36411d7ef1a5a592988712c71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae697335-c958-5640-a518-79ef8caeeb3e/ae697335-c958-5640-a518-79ef8caeeb3e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a1/ada1f4a89f11059afd8f8668970896c6/pa/PN24411_25e03d2cbf2517e1e47ca43009d5dd3d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C1 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN24411%27 HTTP/1.1" 200 None
2026-03-30 09:04:10 [auto1.it] INFO: Saving data for PN24411: {'created_time': 1774861450.220061, 'last_price_update_time': 1774861450.220069, 'auction_closing_time': 1774969825.0}
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PN24411') HTTP/1.1" 204 0
2026-03-30 09:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c157b97d-0b51-5aaf-9901-95bc02198711 with identifier: GJ96809
2026-03-30 09:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c157b97d-0b51-5aaf-9901-95bc02198711 with identifier: GJ96809
2026-03-30 09:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c157b97d-0b51-5aaf-9901-95bc02198711 with identifier: GJ96809 to the API
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:29:19Z',
 'fuel_type': 'petrol',
 'id': 'c157b97d-0b51-5aaf-9901-95bc02198711',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ96809',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 32219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-24',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Black Dots',
 'transmission': 'automatic',
 'trim': 'Black Dots',
 'year': 2024}
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ96809%27 HTTP/1.1" 200 None
2026-03-30 09:04:10 [auto1.it] INFO: Saving data for GJ96809: {'auction_closing_time': 1774970959.0, 'created_time': 1773934624.128098, 'last_price_update_time': 1774861450.58914}
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GJ96809') HTTP/1.1" 204 0
2026-03-30 09:04:10 [auto1.it] INFO: Found listing with ID: LS85229
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS85229%27 HTTP/1.1" 200 None
2026-03-30 09:04:10 [auto1.it] INFO: Scrape type for LS85229: 2
2026-03-30 09:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bbe060e-4cb8-5e41-b3ca-91bfcecb8355 with identifier: LS85229
2026-03-30 09:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bbe060e-4cb8-5e41-b3ca-91bfcecb8355 with scrape type 2
2026-03-30 09:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bbe060e-4cb8-5e41-b3ca-91bfcecb8355 with scrape type 2
2026-03-30 09:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4bbe060e-4cb8-5e41-b3ca-91bfcecb8355, identifier: LS85229
2026-03-30 09:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4bbe060e-4cb8-5e41-b3ca-91bfcecb8355 with identifier: LS85229
2026-03-30 09:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4bbe060e-4cb8-5e41-b3ca-91bfcecb8355 with identifier: LS85229
2026-03-30 09:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4bbe060e-4cb8-5e41-b3ca-91bfcecb8355 with identifier: LS85229 to the API
2026-03-30 09:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:59:57Z',
 'fuel_type': 'diesel',
 'id': '4bbe060e-4cb8-5e41-b3ca-91bfcecb8355',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS85229',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 190407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seller_name': None,
 'title': 'Audi A4 40 TDI Mild-Hybrid advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2020}
2026-03-30 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS85229%27 HTTP/1.1" 200 None
2026-03-30 09:04:12 [auto1.it] INFO: Saving data for LS85229: {'auction_closing_time': 1774972797.0, 'created_time': 1773694827.46348, 'last_price_update_time': 1774861452.122105}
2026-03-30 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LS85229') HTTP/1.1" 204 0
2026-03-30 09:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_e55520c54f08df50bfcf6bfd9bbd0947.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:12 [auto1.it] INFO: Found listing with ID: AN76341
2026-03-30 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN76341%27 HTTP/1.1" 200 None
2026-03-30 09:04:12 [auto1.it] INFO: Scrape type for AN76341: 2
2026-03-30 09:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c7d8026-0b84-50df-947d-a135bf285c05 with identifier: AN76341
2026-03-30 09:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c7d8026-0b84-50df-947d-a135bf285c05 with scrape type 2
2026-03-30 09:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c7d8026-0b84-50df-947d-a135bf285c05 with scrape type 2
2026-03-30 09:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2c7d8026-0b84-50df-947d-a135bf285c05, identifier: AN76341
2026-03-30 09:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063f9010>
2026-03-30 09:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_43682b3fee23ed9a5dec83a275454d8b.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_43682b3fee23ed9a5dec83a275454d8b.jpg saved to cache
2026-03-30 09:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42
2026-03-30 09:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2c7d8026-0b84-50df-947d-a135bf285c05 with identifier: AN76341
2026-03-30 09:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2c7d8026-0b84-50df-947d-a135bf285c05 with identifier: AN76341
2026-03-30 09:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2c7d8026-0b84-50df-947d-a135bf285c05 with identifier: AN76341 to the API
2026-03-30 09:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:58:15Z',
 'fuel_type': 'diesel',
 'id': '2c7d8026-0b84-50df-947d-a135bf285c05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN76341',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 65383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-08',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-30 09:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN76341%27 HTTP/1.1" 200 None
2026-03-30 09:04:13 [auto1.it] INFO: Saving data for AN76341: {'auction_closing_time': 1774972695.0, 'created_time': 1773675017.850855, 'last_price_update_time': 1774861453.634271}
2026-03-30 09:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AN76341') HTTP/1.1" 204 0
2026-03-30 09:04:13 [auto1.it] INFO: Found listing with ID: VN52677
2026-03-30 09:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN52677%27 HTTP/1.1" 200 None
2026-03-30 09:04:13 [auto1.it] INFO: Scrape type for VN52677: 2
2026-03-30 09:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61308aa6-bd28-5620-864c-8308664a841e with identifier: VN52677
2026-03-30 09:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61308aa6-bd28-5620-864c-8308664a841e with scrape type 2
2026-03-30 09:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61308aa6-bd28-5620-864c-8308664a841e with scrape type 2
2026-03-30 09:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 61308aa6-bd28-5620-864c-8308664a841e, identifier: VN52677
2026-03-30 09:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_520db8ae6e42cd6093f3437d9a4ab3f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 61308aa6-bd28-5620-864c-8308664a841e with identifier: VN52677
2026-03-30 09:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 61308aa6-bd28-5620-864c-8308664a841e with identifier: VN52677
2026-03-30 09:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 61308aa6-bd28-5620-864c-8308664a841e with identifier: VN52677 to the API
2026-03-30 09:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:51:19Z',
 'fuel_type': 'diesel',
 'id': '61308aa6-bd28-5620-864c-8308664a841e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN52677',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 160199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-20',
 'seller_name': None,
 'title': 'BMW 1er 120d Urban Line',
 'transmission': 'manual',
 'trim': 'Urban Line',
 'year': 2016}
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN52677%27 HTTP/1.1" 200 None
2026-03-30 09:04:14 [auto1.it] INFO: Saving data for VN52677: {'auction_closing_time': 1774972279.0, 'created_time': 1773522048.734686, 'last_price_update_time': 1774861454.100853}
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VN52677') HTTP/1.1" 204 0
2026-03-30 09:04:14 [auto1.it] INFO: Found listing with ID: KJ50164
2026-03-30 09:04:14 [auto1.it] INFO: Found listing with ID: YM77442
2026-03-30 09:04:14 [auto1.it] INFO: Found listing with ID: HG08694
2026-03-30 09:04:14 [auto1.it] INFO: Found listing with ID: CY67116
2026-03-30 09:04:14 [auto1.it] INFO: Found listing with ID: CW72749
2026-03-30 09:04:14 [auto1.it] INFO: Found listing with ID: VZ97279
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ97279%27 HTTP/1.1" 200 None
2026-03-30 09:04:14 [auto1.it] INFO: Scrape type for VZ97279: 2
2026-03-30 09:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6db40c8d-3c57-53c7-b861-0d2671bda5f4 with identifier: VZ97279
2026-03-30 09:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db40c8d-3c57-53c7-b861-0d2671bda5f4 with scrape type 2
2026-03-30 09:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6db40c8d-3c57-53c7-b861-0d2671bda5f4 with scrape type 2
2026-03-30 09:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6db40c8d-3c57-53c7-b861-0d2671bda5f4, identifier: VZ97279
2026-03-30 09:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR04366> (referer: https://www.auto1.com/v1/car-details-view/SR04366/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX38912/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d9e050>
2026-03-30 09:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_e55520c54f08df50bfcf6bfd9bbd0947.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_e55520c54f08df50bfcf6bfd9bbd0947.jpg saved to cache
2026-03-30 09:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4509fd91-d60a-517e-a196-7566eeb8ca80
2026-03-30 09:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6db40c8d-3c57-53c7-b861-0d2671bda5f4 with identifier: VZ97279
2026-03-30 09:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6db40c8d-3c57-53c7-b861-0d2671bda5f4 with identifier: VZ97279
2026-03-30 09:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6db40c8d-3c57-53c7-b861-0d2671bda5f4 with identifier: VZ97279 to the API
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:36:01Z',
 'fuel_type': 'diesel',
 'id': '6db40c8d-3c57-53c7-b861-0d2671bda5f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ97279',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Delta',
 'odometer': 122663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-17',
 'seller_name': None,
 'title': 'Lancia Delta 1.9 TwinTurbo Diesel S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2013}
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ97279%27 HTTP/1.1" 200 None
2026-03-30 09:04:14 [auto1.it] INFO: Saving data for VZ97279: {'auction_closing_time': 1774971361.0, 'created_time': 1773232898.482761, 'last_price_update_time': 1774861454.703746}
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VZ97279') HTTP/1.1" 204 0
2026-03-30 09:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:14 [auto1.it] INFO: Found listing with ID: BL83628
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL83628%27 HTTP/1.1" 200 None
2026-03-30 09:04:14 [auto1.it] INFO: Scrape type for BL83628: 2
2026-03-30 09:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1791434f-81fe-5320-b348-5476ae6917a3 with identifier: BL83628
2026-03-30 09:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1791434f-81fe-5320-b348-5476ae6917a3 with scrape type 2
2026-03-30 09:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1791434f-81fe-5320-b348-5476ae6917a3 with scrape type 2
2026-03-30 09:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1791434f-81fe-5320-b348-5476ae6917a3, identifier: BL83628
2026-03-30 09:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_d05a7d052003ce42d863eb7862b44c4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_d88c43e122e4b0a71668edae99a52b40.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1791434f-81fe-5320-b348-5476ae6917a3 with identifier: BL83628
2026-03-30 09:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1791434f-81fe-5320-b348-5476ae6917a3 with identifier: BL83628
2026-03-30 09:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1791434f-81fe-5320-b348-5476ae6917a3 with identifier: BL83628 to the API
2026-03-30 09:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:52:12Z',
 'fuel_type': 'diesel',
 'id': '1791434f-81fe-5320-b348-5476ae6917a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL83628',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 199008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-25',
 'seller_name': None,
 'title': 'Fiat Panda 1.3 JTD Climbing 4x4',
 'transmission': 'manual',
 'trim': 'Climbing 4x4',
 'year': 2007}
2026-03-30 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL83628%27 HTTP/1.1" 200 None
2026-03-30 09:04:15 [auto1.it] INFO: Saving data for BL83628: {'auction_closing_time': 1774972332.0, 'created_time': 1773522198.616701, 'last_price_update_time': 1774861455.231183}
2026-03-30 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BL83628') HTTP/1.1" 204 0
2026-03-30 09:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dc6010>
2026-03-30 09:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_520db8ae6e42cd6093f3437d9a4ab3f8.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_520db8ae6e42cd6093f3437d9a4ab3f8.jpg saved to cache
2026-03-30 09:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4509fd91-d60a-517e-a196-7566eeb8ca80
2026-03-30 09:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_18ed3d7467c087011c6c444a9869d63b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:15 [auto1.it] INFO: Found listing with ID: RL69562
2026-03-30 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL69562%27 HTTP/1.1" 200 None
2026-03-30 09:04:15 [auto1.it] INFO: Scrape type for RL69562: 2
2026-03-30 09:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7e077a9-a384-54e1-a70d-8d9e43e0c9d0 with identifier: RL69562
2026-03-30 09:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7e077a9-a384-54e1-a70d-8d9e43e0c9d0 with scrape type 2
2026-03-30 09:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7e077a9-a384-54e1-a70d-8d9e43e0c9d0 with scrape type 2
2026-03-30 09:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c7e077a9-a384-54e1-a70d-8d9e43e0c9d0, identifier: RL69562
2026-03-30 09:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF99312/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c7e077a9-a384-54e1-a70d-8d9e43e0c9d0 with identifier: RL69562
2026-03-30 09:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c7e077a9-a384-54e1-a70d-8d9e43e0c9d0 with identifier: RL69562
2026-03-30 09:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c7e077a9-a384-54e1-a70d-8d9e43e0c9d0 with identifier: RL69562 to the API
2026-03-30 09:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:11:55Z',
 'fuel_type': 'diesel',
 'id': 'c7e077a9-a384-54e1-a70d-8d9e43e0c9d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL69562',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 163936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-14',
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2015}
2026-03-30 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL69562%27 HTTP/1.1" 200 None
2026-03-30 09:04:16 [auto1.it] INFO: Saving data for RL69562: {'auction_closing_time': 1774969915.0, 'created_time': 1773489734.215774, 'last_price_update_time': 1774861456.344508}
2026-03-30 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RL69562') HTTP/1.1" 204 0
2026-03-30 09:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65ca1c64-f026-5120-a52d-63732dd53d8e with identifier: SR04366
2026-03-30 09:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ca1c64-f026-5120-a52d-63732dd53d8e with scrape type 1
2026-03-30 09:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65ca1c64-f026-5120-a52d-63732dd53d8e
2026-03-30 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_618474d29e47c1ae58e9da4577736d35.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_618474d29e47c1ae58e9da4577736d35.jpg not downloaded yet
2026-03-30 09:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_63e2a7d8c65ec2be4117684e7f9557bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:16 [auto1.it] INFO: Found listing with ID: NR87302
2026-03-30 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR87302%27 HTTP/1.1" 200 None
2026-03-30 09:04:16 [auto1.it] INFO: Scrape type for NR87302: 2
2026-03-30 09:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 916b6db6-ac99-5f49-ad9b-75bf818843e7 with identifier: NR87302
2026-03-30 09:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 916b6db6-ac99-5f49-ad9b-75bf818843e7 with scrape type 2
2026-03-30 09:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 916b6db6-ac99-5f49-ad9b-75bf818843e7 with scrape type 2
2026-03-30 09:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 916b6db6-ac99-5f49-ad9b-75bf818843e7, identifier: NR87302
2026-03-30 09:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_68107d7e1548e3d7b332a977144a439b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 916b6db6-ac99-5f49-ad9b-75bf818843e7 with identifier: NR87302
2026-03-30 09:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 916b6db6-ac99-5f49-ad9b-75bf818843e7 with identifier: NR87302
2026-03-30 09:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 916b6db6-ac99-5f49-ad9b-75bf818843e7 with identifier: NR87302 to the API
2026-03-30 09:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:47:52Z',
 'fuel_type': 'petrol',
 'id': '916b6db6-ac99-5f49-ad9b-75bf818843e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR87302',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 93754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-13',
 'seller_name': None,
 'title': 'Fiat 500C 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2016}
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR87302%27 HTTP/1.1" 200 None
2026-03-30 09:04:17 [auto1.it] INFO: Saving data for NR87302: {'auction_closing_time': 1774972072.0, 'created_time': 1773270352.022472, 'last_price_update_time': 1774861457.10169}
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR87302') HTTP/1.1" 204 0
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_bddfa032b71e6b623121a0b0a7d7420e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_bddfa032b71e6b623121a0b0a7d7420e.jpg not downloaded yet
2026-03-30 09:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_883149e87c32018516e2eaa1698ece3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:17 [auto1.it] INFO: Found listing with ID: VL00110
2026-03-30 09:04:17 [auto1.it] INFO: Found listing with ID: AW89631
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW89631%27 HTTP/1.1" 200 None
2026-03-30 09:04:17 [auto1.it] INFO: Scrape type for AW89631: 2
2026-03-30 09:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 252bc6b8-74ec-5f62-ad49-c18d3e9ca544 with identifier: AW89631
2026-03-30 09:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 252bc6b8-74ec-5f62-ad49-c18d3e9ca544 with scrape type 2
2026-03-30 09:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 252bc6b8-74ec-5f62-ad49-c18d3e9ca544 with scrape type 2
2026-03-30 09:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 252bc6b8-74ec-5f62-ad49-c18d3e9ca544, identifier: AW89631
2026-03-30 09:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ58047/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA97320> (referer: https://www.auto1.com/v1/car-details-view/MA97320/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f4ffd0>
2026-03-30 09:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_d05a7d052003ce42d863eb7862b44c4f.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_d05a7d052003ce42d863eb7862b44c4f.jpg saved to cache
2026-03-30 09:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a09fef4-293c-58e9-a9a3-caec9861a249
2026-03-30 09:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06111b50>
2026-03-30 09:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd1%252F3fd1b2073eee552c004fbeca29ebc330%252Fpa%252FZM54486_d88c43e122e4b0a71668edae99a52b40.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_d88c43e122e4b0a71668edae99a52b40.jpg saved to cache
2026-03-30 09:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea036585-d06d-57db-92c9-a238b1e2a9ac
2026-03-30 09:04:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea036585-d06d-57db-92c9-a238b1e2a9ac, skipping ID generation
2026-03-30 09:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea036585-d06d-57db-92c9-a238b1e2a9ac with scrape type 1
2026-03-30 09:04:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea036585-d06d-57db-92c9-a238b1e2a9ac sending to next pipeline
2026-03-30 09:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ea036585-d06d-57db-92c9-a238b1e2a9ac, identifier: ZM54486
2026-03-30 09:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dc29d0>
2026-03-30 09:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_18ed3d7467c087011c6c444a9869d63b.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_18ed3d7467c087011c6c444a9869d63b.jpg saved to cache
2026-03-30 09:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42
2026-03-30 09:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 252bc6b8-74ec-5f62-ad49-c18d3e9ca544 with identifier: AW89631
2026-03-30 09:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 252bc6b8-74ec-5f62-ad49-c18d3e9ca544 with identifier: AW89631
2026-03-30 09:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 252bc6b8-74ec-5f62-ad49-c18d3e9ca544 with identifier: AW89631 to the API
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:21:07Z',
 'fuel_type': 'diesel',
 'id': '252bc6b8-74ec-5f62-ad49-c18d3e9ca544',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW89631',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 156042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 M-Jet S-Design',
 'transmission': 'manual',
 'trim': 'S-Design',
 'year': 2018}
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW89631%27 HTTP/1.1" 200 None
2026-03-30 09:04:18 [auto1.it] INFO: Saving data for AW89631: {'auction_closing_time': 1774970467.0, 'created_time': 1773954880.505954, 'last_price_update_time': 1774861458.589309}
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AW89631') HTTP/1.1" 204 0
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_a9c1130876d366cf6e43ad06dd759412.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_a9c1130876d366cf6e43ad06dd759412.jpg not downloaded yet
2026-03-30 09:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ea036585-d06d-57db-92c9-a238b1e2a9ac with identifier: ZM54486
2026-03-30 09:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ea036585-d06d-57db-92c9-a238b1e2a9ac with identifier: ZM54486
2026-03-30 09:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ea036585-d06d-57db-92c9-a238b1e2a9ac with identifier: ZM54486 to the API
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_d88c43e122e4b0a71668edae99a52b40.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:28:58Z',
 'fuel_type': 'petrol',
 'id': 'ea036585-d06d-57db-92c9-a238b1e2a9ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM54486',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Daihatsu',
 'model': 'Terios',
 'odometer': 74577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2324770,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_a6f4898fa3113d0159091700fa221834.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2317504,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_d88c43e122e4b0a71668edae99a52b40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2258072,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_9941a50215932b4ff30c344692f0a417.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2343826,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_aa03cf1faf915b54c255e447b984d71f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2255556,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_2748437cbab8017d63c37f882c3c1a4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2389177,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_99e0fc0624d53c067e150559286552b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2296490,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_7d8ea891df8e2f16acc4551d27490640.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2477516,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_bd315e32fe2e132b22ef9db63ab62b38.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2431428,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_e56039c97cfa6e8dfedca70a9eff7e49.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea036585-d06d-57db-92c9-a238b1e2a9ac/ea036585-d06d-57db-92c9-a238b1e2a9ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2409636,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d1/3fd1b2073eee552c004fbeca29ebc330/pa/ZM54486_183d3c150924b1087b74ead5abb34083.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Daihatsu Terios 1.5 Hiro 4WD',
 'transmission': 'manual',
 'trim': 'Hiro 4WD',
 'year': 2009}
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM54486%27 HTTP/1.1" 200 None
2026-03-30 09:04:19 [auto1.it] INFO: Saving data for ZM54486: {'created_time': 1774861459.198793, 'last_price_update_time': 1774861459.198803, 'auction_closing_time': 1774970938.0}
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZM54486') HTTP/1.1" 204 0
2026-03-30 09:04:19 [auto1.it] INFO: Found listing with ID: MA00484
2026-03-30 09:04:19 [auto1.it] INFO: Found listing with ID: AX03147
2026-03-30 09:04:19 [auto1.it] INFO: Found listing with ID: SV06431
2026-03-30 09:04:19 [auto1.it] INFO: Found listing with ID: AG39012
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG39012%27 HTTP/1.1" 200 None
2026-03-30 09:04:19 [auto1.it] INFO: Scrape type for AG39012: 2
2026-03-30 09:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b35049c-17a9-5f17-962d-916ace3834ac with identifier: AG39012
2026-03-30 09:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b35049c-17a9-5f17-962d-916ace3834ac with scrape type 2
2026-03-30 09:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b35049c-17a9-5f17-962d-916ace3834ac with scrape type 2
2026-03-30 09:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4b35049c-17a9-5f17-962d-916ace3834ac, identifier: AG39012
2026-03-30 09:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06110090>
2026-03-30 09:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_63e2a7d8c65ec2be4117684e7f9557bf.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_63e2a7d8c65ec2be4117684e7f9557bf.jpg saved to cache
2026-03-30 09:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4509fd91-d60a-517e-a196-7566eeb8ca80
2026-03-30 09:04:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd2f10>
2026-03-30 09:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_68107d7e1548e3d7b332a977144a439b.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_68107d7e1548e3d7b332a977144a439b.jpg saved to cache
2026-03-30 09:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a09fef4-293c-58e9-a9a3-caec9861a249
2026-03-30 09:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4b35049c-17a9-5f17-962d-916ace3834ac with identifier: AG39012
2026-03-30 09:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4b35049c-17a9-5f17-962d-916ace3834ac with identifier: AG39012
2026-03-30 09:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4b35049c-17a9-5f17-962d-916ace3834ac with identifier: AG39012 to the API
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:58:23Z',
 'fuel_type': 'diesel',
 'id': '4b35049c-17a9-5f17-962d-916ace3834ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG39012',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 144430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-08',
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2017}
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG39012%27 HTTP/1.1" 200 None
2026-03-30 09:04:19 [auto1.it] INFO: Saving data for AG39012: {'auction_closing_time': 1774972703.0, 'created_time': 1773954225.052786, 'last_price_update_time': 1774861459.906438}
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AG39012') HTTP/1.1" 204 0
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_404ce6397011bc6ea2b71509f579e0e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_404ce6397011bc6ea2b71509f579e0e8.jpg not downloaded yet
2026-03-30 09:04:19 [auto1.it] INFO: Found listing with ID: TA27022
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA27022%27 HTTP/1.1" 200 None
2026-03-30 09:04:19 [auto1.it] INFO: Scrape type for TA27022: 2
2026-03-30 09:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f8ce014-bc9d-5b86-a860-39d510ef77ed with identifier: TA27022
2026-03-30 09:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f8ce014-bc9d-5b86-a860-39d510ef77ed with scrape type 2
2026-03-30 09:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f8ce014-bc9d-5b86-a860-39d510ef77ed with scrape type 2
2026-03-30 09:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f8ce014-bc9d-5b86-a860-39d510ef77ed, identifier: TA27022
2026-03-30 09:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM60630> (referer: https://www.auto1.com/v1/car-details-view/YM60630/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f8ce014-bc9d-5b86-a860-39d510ef77ed with identifier: TA27022
2026-03-30 09:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f8ce014-bc9d-5b86-a860-39d510ef77ed with identifier: TA27022
2026-03-30 09:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f8ce014-bc9d-5b86-a860-39d510ef77ed with identifier: TA27022 to the API
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:39:43Z',
 'fuel_type': 'diesel',
 'id': '9f8ce014-bc9d-5b86-a860-39d510ef77ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA27022',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 70469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2017}
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA27022%27 HTTP/1.1" 200 None
2026-03-30 09:04:20 [auto1.it] INFO: Saving data for TA27022: {'auction_closing_time': 1774971583.0, 'created_time': 1773270348.231162, 'last_price_update_time': 1774861460.491707}
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TA27022') HTTP/1.1" 204 0
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_b8582f6c39712fc376e27b5765868896.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_b8582f6c39712fc376e27b5765868896.jpg not downloaded yet
2026-03-30 09:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA72760> (referer: https://www.auto1.com/v1/car-details-view/MA72760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ca7090>
2026-03-30 09:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F99%252F8c9983b745a47ff7e5f9ee083d5068fc%252Fpa%252FUZ43487_883149e87c32018516e2eaa1698ece3a.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_883149e87c32018516e2eaa1698ece3a.jpg saved to cache
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42
2026-03-30 09:04:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac659857-c0fc-5db7-9aa6-6fd7942fcf42, skipping ID generation
2026-03-30 09:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42 with scrape type 1
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac659857-c0fc-5db7-9aa6-6fd7942fcf42 sending to next pipeline
2026-03-30 09:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ac659857-c0fc-5db7-9aa6-6fd7942fcf42, identifier: UZ43487
2026-03-30 09:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b47502e-46b8-5409-a146-3cedfe762710 with identifier: MA97320
2026-03-30 09:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b47502e-46b8-5409-a146-3cedfe762710 with scrape type 1
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b47502e-46b8-5409-a146-3cedfe762710
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F68%252F326813c34fc9140eb1c1441391340ae1%252Fpa%252FMA97320_a4b4d4c3c0b12a702710609f93dc4408.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_a4b4d4c3c0b12a702710609f93dc4408.jpg already downloaded
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F68%252F326813c34fc9140eb1c1441391340ae1%252Fpa%252FMA97320_c97372254b67a4aa6151910d31cc59a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_c97372254b67a4aa6151910d31cc59a6.jpg already downloaded
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F68%252F326813c34fc9140eb1c1441391340ae1%252Fpa%252FMA97320_65108118ef137a26664706ea1c73fc4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_65108118ef137a26664706ea1c73fc4f.jpg already downloaded
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F68%252F326813c34fc9140eb1c1441391340ae1%252Fpa%252FMA97320_f6ae2fa20379372fff179f17ee9288b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_f6ae2fa20379372fff179f17ee9288b5.jpg already downloaded
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F68%252F326813c34fc9140eb1c1441391340ae1%252Fpa%252FMA97320_706b27a4a6fbf7ebcc737079edaf7264.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_706b27a4a6fbf7ebcc737079edaf7264.jpg already downloaded
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F68%252F326813c34fc9140eb1c1441391340ae1%252Fpa%252FMA97320_bff566510937eb8d36b57721e67cb1ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_bff566510937eb8d36b57721e67cb1ad.jpg already downloaded
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F68%252F326813c34fc9140eb1c1441391340ae1%252Fpa%252FMA97320_5e991e54d0ac51af75d55c9e7eb729de.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_5e991e54d0ac51af75d55c9e7eb729de.jpg already downloaded
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F68%252F326813c34fc9140eb1c1441391340ae1%252Fpa%252FMA97320_af51a7b963847527be62bcb2a8651a4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_af51a7b963847527be62bcb2a8651a4a.jpg already downloaded
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F68%252F326813c34fc9140eb1c1441391340ae1%252Fpa%252FMA97320_00c51da9c3c35a7366513148854709d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_00c51da9c3c35a7366513148854709d2.jpg already downloaded
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F68%252F326813c34fc9140eb1c1441391340ae1%252Fpa%252FMA97320_22718a2bac6ef6d1e2508304a66949ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_22718a2bac6ef6d1e2508304a66949ab.jpg already downloaded
2026-03-30 09:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0b47502e-46b8-5409-a146-3cedfe762710, identifier: MA97320
2026-03-30 09:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:21 [auto1.it] INFO: Found listing with ID: TJ75613
2026-03-30 09:04:21 [auto1.it] INFO: Found listing with ID: DC35918
2026-03-30 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC35918%27 HTTP/1.1" 200 None
2026-03-30 09:04:21 [auto1.it] INFO: Scrape type for DC35918: 1
2026-03-30 09:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ac659857-c0fc-5db7-9aa6-6fd7942fcf42 with identifier: UZ43487
2026-03-30 09:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ac659857-c0fc-5db7-9aa6-6fd7942fcf42 with identifier: UZ43487
2026-03-30 09:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ac659857-c0fc-5db7-9aa6-6fd7942fcf42 with identifier: UZ43487 to the API
2026-03-30 09:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_883149e87c32018516e2eaa1698ece3a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:22:56Z',
 'fuel_type': 'diesel',
 'id': 'ac659857-c0fc-5db7-9aa6-6fd7942fcf42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ43487',
 'listing': 'auction',
 'location': 'IT, Massa',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 95859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_4d80561e3d0da28bcc6495c864ec1c39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_883149e87c32018516e2eaa1698ece3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_bba8dd8c052f928c2a1ee77515115b90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_18ed3d7467c087011c6c444a9869d63b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_0c2f5ed97729a8eb67463709455e6370.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_43682b3fee23ed9a5dec83a275454d8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_40aa1072fc2af8849685b457c7e7d2e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_e3bd5ee747b2c59914250382b222ea64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_864a15b64acb08e46d1a2d3d520c2161.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac659857-c0fc-5db7-9aa6-6fd7942fcf42/ac659857-c0fc-5db7-9aa6-6fd7942fcf42_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/99/8c9983b745a47ff7e5f9ee083d5068fc/pa/UZ43487_56581ece71ce71579502cebc19c3bd0a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Landmark Edition',
 'transmission': 'manual',
 'trim': 'Landmark Edition',
 'year': 2019}
2026-03-30 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ43487%27 HTTP/1.1" 200 None
2026-03-30 09:04:21 [auto1.it] INFO: Saving data for UZ43487: {'created_time': 1774861461.782439, 'last_price_update_time': 1774861461.782451, 'auction_closing_time': 1774970576.0}
2026-03-30 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UZ43487') HTTP/1.1" 204 0
2026-03-30 09:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0b47502e-46b8-5409-a146-3cedfe762710 with identifier: MA97320
2026-03-30 09:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0b47502e-46b8-5409-a146-3cedfe762710 with identifier: MA97320
2026-03-30 09:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0b47502e-46b8-5409-a146-3cedfe762710 with identifier: MA97320 to the API
2026-03-30 09:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MA97320>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:08:34Z',
 'fuel_type': 'diesel',
 'id': '0b47502e-46b8-5409-a146-3cedfe762710',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA97320',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 61424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_a4b4d4c3c0b12a702710609f93dc4408.jpg',
                'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_c97372254b67a4aa6151910d31cc59a6.jpg',
                'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_65108118ef137a26664706ea1c73fc4f.jpg',
                'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_f6ae2fa20379372fff179f17ee9288b5.jpg',
                'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_706b27a4a6fbf7ebcc737079edaf7264.jpg',
                'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_bff566510937eb8d36b57721e67cb1ad.jpg',
                'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_5e991e54d0ac51af75d55c9e7eb729de.jpg',
                'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_af51a7b963847527be62bcb2a8651a4a.jpg',
                'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_00c51da9c3c35a7366513148854709d2.jpg',
                'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_22718a2bac6ef6d1e2508304a66949ab.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b47502e-46b8-5409-a146-3cedfe762710/0b47502e-46b8-5409-a146-3cedfe762710_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2953665,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_a4b4d4c3c0b12a702710609f93dc4408.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b47502e-46b8-5409-a146-3cedfe762710/0b47502e-46b8-5409-a146-3cedfe762710_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_c97372254b67a4aa6151910d31cc59a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b47502e-46b8-5409-a146-3cedfe762710/0b47502e-46b8-5409-a146-3cedfe762710_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3008152,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_65108118ef137a26664706ea1c73fc4f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b47502e-46b8-5409-a146-3cedfe762710/0b47502e-46b8-5409-a146-3cedfe762710_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_f6ae2fa20379372fff179f17ee9288b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b47502e-46b8-5409-a146-3cedfe762710/0b47502e-46b8-5409-a146-3cedfe762710_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_706b27a4a6fbf7ebcc737079edaf7264.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b47502e-46b8-5409-a146-3cedfe762710/0b47502e-46b8-5409-a146-3cedfe762710_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_bff566510937eb8d36b57721e67cb1ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b47502e-46b8-5409-a146-3cedfe762710/0b47502e-46b8-5409-a146-3cedfe762710_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_5e991e54d0ac51af75d55c9e7eb729de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b47502e-46b8-5409-a146-3cedfe762710/0b47502e-46b8-5409-a146-3cedfe762710_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2759061,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_af51a7b963847527be62bcb2a8651a4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b47502e-46b8-5409-a146-3cedfe762710/0b47502e-46b8-5409-a146-3cedfe762710_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2738994,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_00c51da9c3c35a7366513148854709d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b47502e-46b8-5409-a146-3cedfe762710/0b47502e-46b8-5409-a146-3cedfe762710_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/68/326813c34fc9140eb1c1441391340ae1/pa/MA97320_22718a2bac6ef6d1e2508304a66949ab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2018}
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA97320%27 HTTP/1.1" 200 None
2026-03-30 09:04:22 [auto1.it] INFO: Saving data for MA97320: {'created_time': 1774861462.204274, 'last_price_update_time': 1774861462.204285, 'auction_closing_time': 1774969714.0}
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MA97320') HTTP/1.1" 204 0
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_305a8ef8ef92174416cc0189cb7347cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_305a8ef8ef92174416cc0189cb7347cb.jpg not downloaded yet
2026-03-30 09:04:22 [auto1.it] INFO: Found listing with ID: CM69577
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM69577%27 HTTP/1.1" 200 None
2026-03-30 09:04:22 [auto1.it] INFO: Scrape type for CM69577: 2
2026-03-30 09:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88c5bc3-3d5a-5c3e-a357-68356e830190 with identifier: CM69577
2026-03-30 09:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88c5bc3-3d5a-5c3e-a357-68356e830190 with scrape type 2
2026-03-30 09:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f88c5bc3-3d5a-5c3e-a357-68356e830190 with scrape type 2
2026-03-30 09:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f88c5bc3-3d5a-5c3e-a357-68356e830190, identifier: CM69577
2026-03-30 09:04:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92f89b02-df43-5f45-ac90-3ff36244603c with identifier: YM60630
2026-03-30 09:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92f89b02-df43-5f45-ac90-3ff36244603c with scrape type 1
2026-03-30 09:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92f89b02-df43-5f45-ac90-3ff36244603c
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_f580f061a2d912f3cdbff376d54b2bef.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_f580f061a2d912f3cdbff376d54b2bef.jpg not downloaded yet
2026-03-30 09:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c8e1611-7aae-53be-b668-d7bc75c34ef5 with identifier: MA72760
2026-03-30 09:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5 with scrape type 1
2026-03-30 09:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_5b224e70438699947c2484d98ba61afe.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_5b224e70438699947c2484d98ba61afe.jpg not downloaded yet
2026-03-30 09:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f88c5bc3-3d5a-5c3e-a357-68356e830190 with identifier: CM69577
2026-03-30 09:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f88c5bc3-3d5a-5c3e-a357-68356e830190 with identifier: CM69577
2026-03-30 09:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f88c5bc3-3d5a-5c3e-a357-68356e830190 with identifier: CM69577 to the API
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-31T15:12:01Z',
 'fuel_type': 'hybrid',
 'id': 'f88c5bc3-3d5a-5c3e-a357-68356e830190',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM69577',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 174989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid Dynamic+',
 'transmission': 'automatic',
 'trim': 'Dynamic+',
 'year': 2018}
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM69577%27 HTTP/1.1" 200 None
2026-03-30 09:04:22 [auto1.it] INFO: Saving data for CM69577: {'auction_closing_time': 1774969921.0, 'created_time': 1773501912.279842, 'last_price_update_time': 1774861462.745866}
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CM69577') HTTP/1.1" 204 0
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_e08e5ea49edec01155ba300f9f57cc2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_e08e5ea49edec01155ba300f9f57cc2c.jpg not downloaded yet
2026-03-30 09:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_b18d2a0d0c4482e2f5b9ab95c21d018b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:22 [auto1.it] INFO: Found listing with ID: YV81257
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV81257%27 HTTP/1.1" 200 None
2026-03-30 09:04:22 [auto1.it] INFO: Scrape type for YV81257: 2
2026-03-30 09:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d443e668-d1b6-510d-8603-115fe42dad49 with identifier: YV81257
2026-03-30 09:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d443e668-d1b6-510d-8603-115fe42dad49 with scrape type 2
2026-03-30 09:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d443e668-d1b6-510d-8603-115fe42dad49 with scrape type 2
2026-03-30 09:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d443e668-d1b6-510d-8603-115fe42dad49, identifier: YV81257
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_a0f432dd666c374157c89a7ae67c3366.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_a0f432dd666c374157c89a7ae67c3366.jpg not downloaded yet
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_397afbe7d655c54747fa990da6f7823a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_397afbe7d655c54747fa990da6f7823a.jpg not downloaded yet
2026-03-30 09:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d443e668-d1b6-510d-8603-115fe42dad49 with identifier: YV81257
2026-03-30 09:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d443e668-d1b6-510d-8603-115fe42dad49 with identifier: YV81257
2026-03-30 09:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d443e668-d1b6-510d-8603-115fe42dad49 with identifier: YV81257 to the API
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:42:57Z',
 'fuel_type': 'petrol',
 'id': 'd443e668-d1b6-510d-8603-115fe42dad49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV81257',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 50386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-12',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Mild-Hybrid Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2022}
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV81257%27 HTTP/1.1" 200 None
2026-03-30 09:04:23 [auto1.it] INFO: Saving data for YV81257: {'auction_closing_time': 1774971777.0, 'created_time': 1774472468.290548, 'last_price_update_time': 1774861463.32548}
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YV81257') HTTP/1.1" 204 0
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_816d689a0cc7aa419a43b4a9bac8d77c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_816d689a0cc7aa419a43b4a9bac8d77c.jpg not downloaded yet
2026-03-30 09:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_eb91fbc582bf55583e67796c2a625dce.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_cb02e9e41e7a8cc772fa9c703ada6662.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:23 [auto1.it] INFO: Found listing with ID: SC87766
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC87766%27 HTTP/1.1" 200 None
2026-03-30 09:04:23 [auto1.it] INFO: Scrape type for SC87766: 2
2026-03-30 09:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3663080-d0be-524b-9098-3bdebb075174 with identifier: SC87766
2026-03-30 09:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3663080-d0be-524b-9098-3bdebb075174 with scrape type 2
2026-03-30 09:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3663080-d0be-524b-9098-3bdebb075174 with scrape type 2
2026-03-30 09:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d3663080-d0be-524b-9098-3bdebb075174, identifier: SC87766
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_c3ef50b5f8a3096a9e59bdc5f40d7960.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_c3ef50b5f8a3096a9e59bdc5f40d7960.jpg not downloaded yet
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_aa4f3f1e8d12143e94b748953e69e108.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_aa4f3f1e8d12143e94b748953e69e108.jpg not downloaded yet
2026-03-30 09:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_89a0ae39d9a1886a51e6cb6cf1549613.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d3663080-d0be-524b-9098-3bdebb075174 with identifier: SC87766
2026-03-30 09:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d3663080-d0be-524b-9098-3bdebb075174 with identifier: SC87766
2026-03-30 09:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d3663080-d0be-524b-9098-3bdebb075174 with identifier: SC87766 to the API
2026-03-30 09:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:30:27Z',
 'fuel_type': 'diesel',
 'id': 'd3663080-d0be-524b-9098-3bdebb075174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC87766',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 99199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-08',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC87766%27 HTTP/1.1" 200 None
2026-03-30 09:04:24 [auto1.it] INFO: Saving data for SC87766: {'auction_closing_time': 1774971027.0, 'created_time': 1773404945.750995, 'last_price_update_time': 1774861464.692877}
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC87766') HTTP/1.1" 204 0
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_15b6ad6d243fde81ed831933baf68cff.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_15b6ad6d243fde81ed831933baf68cff.jpg not downloaded yet
2026-03-30 09:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0638a0d0>
2026-03-30 09:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_b18d2a0d0c4482e2f5b9ab95c21d018b.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_b18d2a0d0c4482e2f5b9ab95c21d018b.jpg saved to cache
2026-03-30 09:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a09fef4-293c-58e9-a9a3-caec9861a249
2026-03-30 09:04:24 [auto1.it] INFO: Found listing with ID: HW75415
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_fffe03faaba3ae0abe08a77f19563b0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_fffe03faaba3ae0abe08a77f19563b0d.jpg not downloaded yet
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_c2ade1bde876d26b548b61e9e99ab059.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c2ade1bde876d26b548b61e9e99ab059.jpg not downloaded yet
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_8af77ba566e76e14f2063495814ee429.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_8af77ba566e76e14f2063495814ee429.jpg not downloaded yet
2026-03-30 09:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0628c8d0>
2026-03-30 09:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_eb91fbc582bf55583e67796c2a625dce.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_eb91fbc582bf55583e67796c2a625dce.jpg saved to cache
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a09fef4-293c-58e9-a9a3-caec9861a249
2026-03-30 09:04:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f53810>
2026-03-30 09:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_cb02e9e41e7a8cc772fa9c703ada6662.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_cb02e9e41e7a8cc772fa9c703ada6662.jpg saved to cache
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a09fef4-293c-58e9-a9a3-caec9861a249
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_7d1e5d4a93f92e96e6d53600e8db475a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_7d1e5d4a93f92e96e6d53600e8db475a.jpg not downloaded yet
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_4b1154cc1669d52272a78ed853f7a6c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_4b1154cc1669d52272a78ed853f7a6c7.jpg not downloaded yet
2026-03-30 09:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_fc5ba308640b9913819e258338e5db41.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_5b224e70438699947c2484d98ba61afe.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e88950>
2026-03-30 09:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F15%252Fd915921ec38ea9d1ed7a580fa8485fe2%252Fpa%252FBE54405_89a0ae39d9a1886a51e6cb6cf1549613.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_89a0ae39d9a1886a51e6cb6cf1549613.jpg saved to cache
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4509fd91-d60a-517e-a196-7566eeb8ca80
2026-03-30 09:04:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4509fd91-d60a-517e-a196-7566eeb8ca80, skipping ID generation
2026-03-30 09:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4509fd91-d60a-517e-a196-7566eeb8ca80 with scrape type 1
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4509fd91-d60a-517e-a196-7566eeb8ca80 sending to next pipeline
2026-03-30 09:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4509fd91-d60a-517e-a196-7566eeb8ca80, identifier: BE54405
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_6c81bdacf3b71f9d0bf1e5dcefcd7072.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_6c81bdacf3b71f9d0bf1e5dcefcd7072.jpg not downloaded yet
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_f194de2c5f1400ff8f71e7feb6c774c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_f194de2c5f1400ff8f71e7feb6c774c5.jpg not downloaded yet
2026-03-30 09:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4509fd91-d60a-517e-a196-7566eeb8ca80 with identifier: BE54405
2026-03-30 09:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4509fd91-d60a-517e-a196-7566eeb8ca80 with identifier: BE54405
2026-03-30 09:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4509fd91-d60a-517e-a196-7566eeb8ca80 with identifier: BE54405 to the API
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_89a0ae39d9a1886a51e6cb6cf1549613.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:38:01Z',
 'fuel_type': 'petrol',
 'id': '4509fd91-d60a-517e-a196-7566eeb8ca80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE54405',
 'listing': 'auction',
 'location': 'IT, Torino',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 74577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_3da492bc58efa0452b46889422a4d757.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_7aef6c99c886dad5e87054c83d5e4519.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_89a0ae39d9a1886a51e6cb6cf1549613.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_63e2a7d8c65ec2be4117684e7f9557bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_587c89b8e57a007f4ce9ee3ffdd11cf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_f97ccbe064c2c23db71efee8f7ced5f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_520db8ae6e42cd6093f3437d9a4ab3f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_e55520c54f08df50bfcf6bfd9bbd0947.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_4f8fd3838d6133799d9f0fa787cea2ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4509fd91-d60a-517e-a196-7566eeb8ca80/4509fd91-d60a-517e-a196-7566eeb8ca80_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/15/d915921ec38ea9d1ed7a580fa8485fe2/pa/BE54405_2f616bd20fca91cd373d7cd46876daa9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 30 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE54405%27 HTTP/1.1" 200 None
2026-03-30 09:04:25 [auto1.it] INFO: Saving data for BE54405: {'created_time': 1774861465.784893, 'last_price_update_time': 1774861465.784908, 'auction_closing_time': 1774971481.0}
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BE54405') HTTP/1.1" 204 0
2026-03-30 09:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c2ade1bde876d26b548b61e9e99ab059.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_62871d575406c5216e131cff7ad3194e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_62871d575406c5216e131cff7ad3194e.jpg not downloaded yet
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_c3e6d748b61429363873d5af0f689dd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c3e6d748b61429363873d5af0f689dd5.jpg not downloaded yet
2026-03-30 09:04:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fa7610>
2026-03-30 09:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fa3%252F76a32968bf45d18b92b8f451a035c8fe%252Fpa%252FGW20152_fc5ba308640b9913819e258338e5db41.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_fc5ba308640b9913819e258338e5db41.jpg saved to cache
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a09fef4-293c-58e9-a9a3-caec9861a249
2026-03-30 09:04:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a09fef4-293c-58e9-a9a3-caec9861a249, skipping ID generation
2026-03-30 09:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a09fef4-293c-58e9-a9a3-caec9861a249 with scrape type 1
2026-03-30 09:04:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a09fef4-293c-58e9-a9a3-caec9861a249 sending to next pipeline
2026-03-30 09:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2a09fef4-293c-58e9-a9a3-caec9861a249, identifier: GW20152
2026-03-30 09:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c63e10>
2026-03-30 09:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_5b224e70438699947c2484d98ba61afe.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_5b224e70438699947c2484d98ba61afe.jpg saved to cache
2026-03-30 09:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-03-30 09:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2a09fef4-293c-58e9-a9a3-caec9861a249 with identifier: GW20152
2026-03-30 09:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2a09fef4-293c-58e9-a9a3-caec9861a249 with identifier: GW20152
2026-03-30 09:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2a09fef4-293c-58e9-a9a3-caec9861a249 with identifier: GW20152 to the API
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_fc5ba308640b9913819e258338e5db41.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:51:16Z',
 'fuel_type': 'petrol',
 'id': '2a09fef4-293c-58e9-a9a3-caec9861a249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW20152',
 'listing': 'auction',
 'location': 'IT, Mariano Comense',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 138832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2559169,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_d05a7d052003ce42d863eb7862b44c4f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2394456,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_51899ec672d5a71fab9b0865612f5eac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2490339,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_4efb232a64198da00ec7fc3d839dadf3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2220519,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_74f24b6e557fca67e7fb8083182f10ae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2442390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_68107d7e1548e3d7b332a977144a439b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2239313,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_eb91fbc582bf55583e67796c2a625dce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2225187,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_cb02e9e41e7a8cc772fa9c703ada6662.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2455154,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_b18d2a0d0c4482e2f5b9ab95c21d018b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_2d850ab8c51c5159ba0685cecc4f61ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a09fef4-293c-58e9-a9a3-caec9861a249/2a09fef4-293c-58e9-a9a3-caec9861a249_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3018326,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/a3/76a32968bf45d18b92b8f451a035c8fe/pa/GW20152_fc5ba308640b9913819e258338e5db41.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2012}
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW20152%27 HTTP/1.1" 200 None
2026-03-30 09:04:26 [auto1.it] INFO: Saving data for GW20152: {'created_time': 1774861466.735083, 'last_price_update_time': 1774861466.735093, 'auction_closing_time': 1774972276.0}
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GW20152') HTTP/1.1" 204 0
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_673fdc27bfcdaecae2d2f40ada72d47b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_673fdc27bfcdaecae2d2f40ada72d47b.jpg not downloaded yet
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_320a7043e9ab251284d5862c2f9adf86.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_320a7043e9ab251284d5862c2f9adf86.jpg not downloaded yet
2026-03-30 09:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_4b1154cc1669d52272a78ed853f7a6c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL99970/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW57613/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC35918/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_7d1e5d4a93f92e96e6d53600e8db475a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_679ae4c5305a1af446042f0ae57dbdfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_679ae4c5305a1af446042f0ae57dbdfe.jpg not downloaded yet
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_153d068a5f180d7c000b29789a074a76.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_153d068a5f180d7c000b29789a074a76.jpg not downloaded yet
2026-03-30 09:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF99312> (referer: https://www.auto1.com/v1/car-details-view/DF99312/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06191390>
2026-03-30 09:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_c2ade1bde876d26b548b61e9e99ab059.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c2ade1bde876d26b548b61e9e99ab059.jpg saved to cache
2026-03-30 09:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_e2edde0b77da3ec4872bc8c3918f2c6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_e2edde0b77da3ec4872bc8c3918f2c6b.jpg not downloaded yet
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_af23ccbbaef8dc8d3ff49793914e4977.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_af23ccbbaef8dc8d3ff49793914e4977.jpg not downloaded yet
2026-03-30 09:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c81d10>
2026-03-30 09:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_4b1154cc1669d52272a78ed853f7a6c7.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_4b1154cc1669d52272a78ed853f7a6c7.jpg saved to cache
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-03-30 09:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0633e950>
2026-03-30 09:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_7d1e5d4a93f92e96e6d53600e8db475a.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_7d1e5d4a93f92e96e6d53600e8db475a.jpg saved to cache
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92f89b02-df43-5f45-ac90-3ff36244603c
2026-03-30 09:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_f194de2c5f1400ff8f71e7feb6c774c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f285a5a3-e78b-506a-8610-2605f8cfaad4 with identifier: DF99312
2026-03-30 09:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f285a5a3-e78b-506a-8610-2605f8cfaad4 with scrape type 1
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f285a5a3-e78b-506a-8610-2605f8cfaad4
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_3f8dc05a9242ae2b3d4cdc6c5e7e61fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_3f8dc05a9242ae2b3d4cdc6c5e7e61fd.jpg not downloaded yet
2026-03-30 09:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c3e6d748b61429363873d5af0f689dd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_41ef226267a719c3549721c604a258b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_41ef226267a719c3549721c604a258b7.jpg not downloaded yet
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_c29ece75578a94b3d8f01bb69b596db6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_c29ece75578a94b3d8f01bb69b596db6.jpg not downloaded yet
2026-03-30 09:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX38912> (referer: https://www.auto1.com/v1/car-details-view/LX38912/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_5387f28730c7a435f485e7a4dac131ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_5387f28730c7a435f485e7a4dac131ca.jpg not downloaded yet
2026-03-30 09:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06171150>
2026-03-30 09:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_f194de2c5f1400ff8f71e7feb6c774c5.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_f194de2c5f1400ff8f71e7feb6c774c5.jpg saved to cache
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_cd27745678ebbba0058eab114f69b8ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_cd27745678ebbba0058eab114f69b8ec.jpg not downloaded yet
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_bbe3756164eba5650854bf33e3001acc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_bbe3756164eba5650854bf33e3001acc.jpg not downloaded yet
2026-03-30 09:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_320a7043e9ab251284d5862c2f9adf86.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_5a18b85af67f575142ba08341f058283.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_5a18b85af67f575142ba08341f058283.jpg not downloaded yet
2026-03-30 09:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd0d90>
2026-03-30 09:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_c3e6d748b61429363873d5af0f689dd5.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c3e6d748b61429363873d5af0f689dd5.jpg saved to cache
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_e2688cb1052fb4bde420f93c4e4eb8be.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_e2688cb1052fb4bde420f93c4e4eb8be.jpg not downloaded yet
2026-03-30 09:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4 with identifier: LX38912
2026-03-30 09:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4 with scrape type 1
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F51%252Fe5519be4496210516d7b886db15869a9%252Fpa%252FLX38912_0bef2d29bdf2c7ef00ac6f5d0b03d547.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_0bef2d29bdf2c7ef00ac6f5d0b03d547.jpg already downloaded
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F51%252Fe5519be4496210516d7b886db15869a9%252Fpa%252FLX38912_28259b8a8fd4f15ae2080378ec67c303.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_28259b8a8fd4f15ae2080378ec67c303.jpg already downloaded
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F51%252Fe5519be4496210516d7b886db15869a9%252Fpa%252FLX38912_cf2095a0bedf86f397b1d10550fef731.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_cf2095a0bedf86f397b1d10550fef731.jpg already downloaded
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F51%252Fe5519be4496210516d7b886db15869a9%252Fpa%252FLX38912_bc392994738bd945081d02172b9088fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_bc392994738bd945081d02172b9088fb.jpg already downloaded
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F51%252Fe5519be4496210516d7b886db15869a9%252Fpa%252FLX38912_e3c7cbf09674fd58fc11de7caccd7181.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_e3c7cbf09674fd58fc11de7caccd7181.jpg already downloaded
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F51%252Fe5519be4496210516d7b886db15869a9%252Fpa%252FLX38912_509e220bc06741fd322ac25a2a1979e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_509e220bc06741fd322ac25a2a1979e3.jpg already downloaded
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F51%252Fe5519be4496210516d7b886db15869a9%252Fpa%252FLX38912_a98ca65c4766fc7c300dd91b08f24d76.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_a98ca65c4766fc7c300dd91b08f24d76.jpg already downloaded
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F51%252Fe5519be4496210516d7b886db15869a9%252Fpa%252FLX38912_d83ed5ee06c3a6b620a04b2f1586b554.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_d83ed5ee06c3a6b620a04b2f1586b554.jpg already downloaded
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F51%252Fe5519be4496210516d7b886db15869a9%252Fpa%252FLX38912_4a5a1d98602c9b11c0960f728a7ec53d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_4a5a1d98602c9b11c0960f728a7ec53d.jpg already downloaded
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F51%252Fe5519be4496210516d7b886db15869a9%252Fpa%252FLX38912_2d60e7c96e8c841a2517b2368b97ff0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_2d60e7c96e8c841a2517b2368b97ff0f.jpg already downloaded
2026-03-30 09:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4, identifier: LX38912
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_27f983a9df6a12adf90f2d0c68ae1e92.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_27f983a9df6a12adf90f2d0c68ae1e92.jpg not downloaded yet
2026-03-30 09:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4 with identifier: LX38912
2026-03-30 09:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4 with identifier: LX38912
2026-03-30 09:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4 with identifier: LX38912 to the API
2026-03-30 09:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LX38912>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:22:46Z',
 'fuel_type': 'diesel',
 'id': 'cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX38912',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 110250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_0bef2d29bdf2c7ef00ac6f5d0b03d547.jpg',
                'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_28259b8a8fd4f15ae2080378ec67c303.jpg',
                'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_cf2095a0bedf86f397b1d10550fef731.jpg',
                'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_bc392994738bd945081d02172b9088fb.jpg',
                'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_e3c7cbf09674fd58fc11de7caccd7181.jpg',
                'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_509e220bc06741fd322ac25a2a1979e3.jpg',
                'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_a98ca65c4766fc7c300dd91b08f24d76.jpg',
                'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_d83ed5ee06c3a6b620a04b2f1586b554.jpg',
                'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_4a5a1d98602c9b11c0960f728a7ec53d.jpg',
                'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_2d60e7c96e8c841a2517b2368b97ff0f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4/cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2468199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_0bef2d29bdf2c7ef00ac6f5d0b03d547.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4/cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2410094,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_28259b8a8fd4f15ae2080378ec67c303.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4/cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2425029,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_cf2095a0bedf86f397b1d10550fef731.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4/cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2110210,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_bc392994738bd945081d02172b9088fb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4/cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2409752,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_e3c7cbf09674fd58fc11de7caccd7181.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4/cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2365634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_509e220bc06741fd322ac25a2a1979e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4/cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_a98ca65c4766fc7c300dd91b08f24d76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4/cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2319190,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_d83ed5ee06c3a6b620a04b2f1586b554.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4/cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_4a5a1d98602c9b11c0960f728a7ec53d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4/cf1aa5b4-b25f-5bd9-9603-24a5bb7ee1a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2177285,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/51/e5519be4496210516d7b886db15869a9/pa/LX38912_2d60e7c96e8c841a2517b2368b97ff0f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Opening Edition',
 'transmission': 'manual',
 'trim': 'Opening Edition',
 'year': 2016}
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX38912%27 HTTP/1.1" 200 None
2026-03-30 09:04:28 [auto1.it] INFO: Saving data for LX38912: {'created_time': 1774861468.17029, 'last_price_update_time': 1774861468.170301, 'auction_closing_time': 1774970566.0}
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX38912') HTTP/1.1" 204 0
2026-03-30 09:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_a9c1130876d366cf6e43ad06dd759412.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_84d3433ec9d150c0facf5632c665edf5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_84d3433ec9d150c0facf5632c665edf5.jpg not downloaded yet
2026-03-30 09:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ58047> (referer: https://www.auto1.com/v1/car-details-view/ZZ58047/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06170750>
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_320a7043e9ab251284d5862c2f9adf86.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_320a7043e9ab251284d5862c2f9adf86.jpg saved to cache
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-03-30 09:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_618474d29e47c1ae58e9da4577736d35.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_bddfa032b71e6b623121a0b0a7d7420e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_404ce6397011bc6ea2b71509f579e0e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_fffe03faaba3ae0abe08a77f19563b0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_15b6ad6d243fde81ed831933baf68cff.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_673fdc27bfcdaecae2d2f40ada72d47b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_62871d575406c5216e131cff7ad3194e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e371d0>
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_a9c1130876d366cf6e43ad06dd759412.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_a9c1130876d366cf6e43ad06dd759412.jpg saved to cache
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65ca1c64-f026-5120-a52d-63732dd53d8e
2026-03-30 09:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_c29ece75578a94b3d8f01bb69b596db6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_27f983a9df6a12adf90f2d0c68ae1e92.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_bbe3756164eba5650854bf33e3001acc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e60922-4029-5d78-98ed-78fbe9a7f19d with identifier: ZZ58047
2026-03-30 09:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e60922-4029-5d78-98ed-78fbe9a7f19d with scrape type 1
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 22e60922-4029-5d78-98ed-78fbe9a7f19d
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F7d%252Faa7d1f655f8bfb5aa657790e04c8bfcd%252Fpa%252FZZ58047_35332f06f70cbcb896ec0b8a392df21c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_35332f06f70cbcb896ec0b8a392df21c.jpg already downloaded
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F7d%252Faa7d1f655f8bfb5aa657790e04c8bfcd%252Fpa%252FZZ58047_7d14730525034436213f1bdb2d11c266.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_7d14730525034436213f1bdb2d11c266.jpg already downloaded
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F7d%252Faa7d1f655f8bfb5aa657790e04c8bfcd%252Fpa%252FZZ58047_e7b4815526589de3ac9100fe71713bcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_e7b4815526589de3ac9100fe71713bcc.jpg already downloaded
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F7d%252Faa7d1f655f8bfb5aa657790e04c8bfcd%252Fpa%252FZZ58047_7a3882b5cee4e4d0d1b4d9104160286b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_7a3882b5cee4e4d0d1b4d9104160286b.jpg already downloaded
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F7d%252Faa7d1f655f8bfb5aa657790e04c8bfcd%252Fpa%252FZZ58047_b3fc17646399a23adfe96e1007e4cf7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_b3fc17646399a23adfe96e1007e4cf7e.jpg already downloaded
2026-03-30 09:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 22e60922-4029-5d78-98ed-78fbe9a7f19d, identifier: ZZ58047
2026-03-30 09:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062cf410>
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_618474d29e47c1ae58e9da4577736d35.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_618474d29e47c1ae58e9da4577736d35.jpg saved to cache
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65ca1c64-f026-5120-a52d-63732dd53d8e
2026-03-30 09:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d316d0>
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_bddfa032b71e6b623121a0b0a7d7420e.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_bddfa032b71e6b623121a0b0a7d7420e.jpg saved to cache
2026-03-30 09:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65ca1c64-f026-5120-a52d-63732dd53d8e
2026-03-30 09:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd3ad0>
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_404ce6397011bc6ea2b71509f579e0e8.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_404ce6397011bc6ea2b71509f579e0e8.jpg saved to cache
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65ca1c64-f026-5120-a52d-63732dd53d8e
2026-03-30 09:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dc3fd0>
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_fffe03faaba3ae0abe08a77f19563b0d.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_fffe03faaba3ae0abe08a77f19563b0d.jpg saved to cache
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92f89b02-df43-5f45-ac90-3ff36244603c
2026-03-30 09:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063ed6d0>
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_15b6ad6d243fde81ed831933baf68cff.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_15b6ad6d243fde81ed831933baf68cff.jpg saved to cache
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65ca1c64-f026-5120-a52d-63732dd53d8e
2026-03-30 09:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d329d0>
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_673fdc27bfcdaecae2d2f40ada72d47b.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_673fdc27bfcdaecae2d2f40ada72d47b.jpg saved to cache
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92f89b02-df43-5f45-ac90-3ff36244603c
2026-03-30 09:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d4b150>
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_62871d575406c5216e131cff7ad3194e.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_62871d575406c5216e131cff7ad3194e.jpg saved to cache
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92f89b02-df43-5f45-ac90-3ff36244603c
2026-03-30 09:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 22e60922-4029-5d78-98ed-78fbe9a7f19d with identifier: ZZ58047
2026-03-30 09:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 22e60922-4029-5d78-98ed-78fbe9a7f19d with identifier: ZZ58047
2026-03-30 09:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 22e60922-4029-5d78-98ed-78fbe9a7f19d with identifier: ZZ58047 to the API
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZZ58047>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:13:10Z',
 'fuel_type': 'petrol',
 'id': '22e60922-4029-5d78-98ed-78fbe9a7f19d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ58047',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 119521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_35332f06f70cbcb896ec0b8a392df21c.jpg',
                'https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_7d14730525034436213f1bdb2d11c266.jpg',
                'https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_e7b4815526589de3ac9100fe71713bcc.jpg',
                'https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_7a3882b5cee4e4d0d1b4d9104160286b.jpg',
                'https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_b3fc17646399a23adfe96e1007e4cf7e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e60922-4029-5d78-98ed-78fbe9a7f19d/22e60922-4029-5d78-98ed-78fbe9a7f19d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_35332f06f70cbcb896ec0b8a392df21c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e60922-4029-5d78-98ed-78fbe9a7f19d/22e60922-4029-5d78-98ed-78fbe9a7f19d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_7d14730525034436213f1bdb2d11c266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e60922-4029-5d78-98ed-78fbe9a7f19d/22e60922-4029-5d78-98ed-78fbe9a7f19d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_e7b4815526589de3ac9100fe71713bcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e60922-4029-5d78-98ed-78fbe9a7f19d/22e60922-4029-5d78-98ed-78fbe9a7f19d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_7a3882b5cee4e4d0d1b4d9104160286b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e60922-4029-5d78-98ed-78fbe9a7f19d/22e60922-4029-5d78-98ed-78fbe9a7f19d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/7d/aa7d1f655f8bfb5aa657790e04c8bfcd/pa/ZZ58047_b3fc17646399a23adfe96e1007e4cf7e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2005}
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ58047%27 HTTP/1.1" 200 None
2026-03-30 09:04:29 [auto1.it] INFO: Saving data for ZZ58047: {'created_time': 1774861469.853942, 'last_price_update_time': 1774861469.853952, 'auction_closing_time': 1774969990.0}
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ58047') HTTP/1.1" 204 0
2026-03-30 09:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC35918> (referer: https://www.auto1.com/v1/car-details-view/DC35918/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW57613> (referer: https://www.auto1.com/v1/car-details-view/UW57613/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c1fdd0>
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_c29ece75578a94b3d8f01bb69b596db6.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_c29ece75578a94b3d8f01bb69b596db6.jpg saved to cache
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f285a5a3-e78b-506a-8610-2605f8cfaad4
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ca4310>
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_27f983a9df6a12adf90f2d0c68ae1e92.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_27f983a9df6a12adf90f2d0c68ae1e92.jpg saved to cache
2026-03-30 09:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f285a5a3-e78b-506a-8610-2605f8cfaad4
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06242b90>
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_bbe3756164eba5650854bf33e3001acc.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_bbe3756164eba5650854bf33e3001acc.jpg saved to cache
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f285a5a3-e78b-506a-8610-2605f8cfaad4
2026-03-30 09:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc805765-48a7-563a-a008-e7690e3c93d1 with identifier: DC35918
2026-03-30 09:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc805765-48a7-563a-a008-e7690e3c93d1 with scrape type 1
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fc805765-48a7-563a-a008-e7690e3c93d1
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fe6%252Ffae6336346de8803e78dbe1fcaa79ccc%252Fpa%252FDC35918_0a86c1d85fd5d71dac00a7335df8a995.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_0a86c1d85fd5d71dac00a7335df8a995.jpg not downloaded yet
2026-03-30 09:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c52748a-0f40-5822-8483-ad2936b35dbc with identifier: UW57613
2026-03-30 09:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c52748a-0f40-5822-8483-ad2936b35dbc with scrape type 1
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c52748a-0f40-5822-8483-ad2936b35dbc
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2f%252F952f38c7aa70453296a7e85b9ad6feb6%252Fpa%252FUW57613_024459022941829b6bbe54388e93c9e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_024459022941829b6bbe54388e93c9e5.jpg already downloaded
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2f%252F952f38c7aa70453296a7e85b9ad6feb6%252Fpa%252FUW57613_201ee3e7c766274aad51da398c7e465d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_201ee3e7c766274aad51da398c7e465d.jpg already downloaded
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2f%252F952f38c7aa70453296a7e85b9ad6feb6%252Fpa%252FUW57613_ba89bbcddd17b1ac8e09554931dc6700.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_ba89bbcddd17b1ac8e09554931dc6700.jpg already downloaded
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2f%252F952f38c7aa70453296a7e85b9ad6feb6%252Fpa%252FUW57613_250d87c921cbadb0fb597cc7ec93a976.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_250d87c921cbadb0fb597cc7ec93a976.jpg already downloaded
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2f%252F952f38c7aa70453296a7e85b9ad6feb6%252Fpa%252FUW57613_f7c30c50445adb03d445909a7114a589.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_f7c30c50445adb03d445909a7114a589.jpg already downloaded
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2f%252F952f38c7aa70453296a7e85b9ad6feb6%252Fpa%252FUW57613_b58f9f7d0cec264958dafe0d1806a192.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_b58f9f7d0cec264958dafe0d1806a192.jpg already downloaded
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2f%252F952f38c7aa70453296a7e85b9ad6feb6%252Fpa%252FUW57613_3cd7c2ff6df67fe6cb9e64380aa03160.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_3cd7c2ff6df67fe6cb9e64380aa03160.jpg already downloaded
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2f%252F952f38c7aa70453296a7e85b9ad6feb6%252Fpa%252FUW57613_da616e4e8681e9df196e2f53e951bfea.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_da616e4e8681e9df196e2f53e951bfea.jpg already downloaded
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2f%252F952f38c7aa70453296a7e85b9ad6feb6%252Fpa%252FUW57613_89875b9a50d41f14f4070d24a8aa67e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_89875b9a50d41f14f4070d24a8aa67e8.jpg already downloaded
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F2f%252F952f38c7aa70453296a7e85b9ad6feb6%252Fpa%252FUW57613_8bfa0d94256bc00af3accdf9072e28d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_8bfa0d94256bc00af3accdf9072e28d2.jpg already downloaded
2026-03-30 09:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c52748a-0f40-5822-8483-ad2936b35dbc, identifier: UW57613
2026-03-30 09:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c52748a-0f40-5822-8483-ad2936b35dbc with identifier: UW57613
2026-03-30 09:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c52748a-0f40-5822-8483-ad2936b35dbc with identifier: UW57613
2026-03-30 09:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c52748a-0f40-5822-8483-ad2936b35dbc with identifier: UW57613 to the API
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UW57613>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:39:07Z',
 'fuel_type': 'diesel',
 'id': '5c52748a-0f40-5822-8483-ad2936b35dbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW57613',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 254200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_024459022941829b6bbe54388e93c9e5.jpg',
                'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_201ee3e7c766274aad51da398c7e465d.jpg',
                'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_ba89bbcddd17b1ac8e09554931dc6700.jpg',
                'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_250d87c921cbadb0fb597cc7ec93a976.jpg',
                'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_f7c30c50445adb03d445909a7114a589.jpg',
                'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_b58f9f7d0cec264958dafe0d1806a192.jpg',
                'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_3cd7c2ff6df67fe6cb9e64380aa03160.jpg',
                'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_da616e4e8681e9df196e2f53e951bfea.jpg',
                'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_89875b9a50d41f14f4070d24a8aa67e8.jpg',
                'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_8bfa0d94256bc00af3accdf9072e28d2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c52748a-0f40-5822-8483-ad2936b35dbc/5c52748a-0f40-5822-8483-ad2936b35dbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_024459022941829b6bbe54388e93c9e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c52748a-0f40-5822-8483-ad2936b35dbc/5c52748a-0f40-5822-8483-ad2936b35dbc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_201ee3e7c766274aad51da398c7e465d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c52748a-0f40-5822-8483-ad2936b35dbc/5c52748a-0f40-5822-8483-ad2936b35dbc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_ba89bbcddd17b1ac8e09554931dc6700.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c52748a-0f40-5822-8483-ad2936b35dbc/5c52748a-0f40-5822-8483-ad2936b35dbc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_250d87c921cbadb0fb597cc7ec93a976.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c52748a-0f40-5822-8483-ad2936b35dbc/5c52748a-0f40-5822-8483-ad2936b35dbc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_f7c30c50445adb03d445909a7114a589.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c52748a-0f40-5822-8483-ad2936b35dbc/5c52748a-0f40-5822-8483-ad2936b35dbc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_b58f9f7d0cec264958dafe0d1806a192.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c52748a-0f40-5822-8483-ad2936b35dbc/5c52748a-0f40-5822-8483-ad2936b35dbc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_3cd7c2ff6df67fe6cb9e64380aa03160.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c52748a-0f40-5822-8483-ad2936b35dbc/5c52748a-0f40-5822-8483-ad2936b35dbc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_da616e4e8681e9df196e2f53e951bfea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c52748a-0f40-5822-8483-ad2936b35dbc/5c52748a-0f40-5822-8483-ad2936b35dbc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_89875b9a50d41f14f4070d24a8aa67e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c52748a-0f40-5822-8483-ad2936b35dbc/5c52748a-0f40-5822-8483-ad2936b35dbc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/2f/952f38c7aa70453296a7e85b9ad6feb6/pa/UW57613_8bfa0d94256bc00af3accdf9072e28d2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2011}
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW57613%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [auto1.it] INFO: Saving data for UW57613: {'created_time': 1774861470.673381, 'last_price_update_time': 1774861470.673394, 'auction_closing_time': 1774971547.0}
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UW57613') HTTP/1.1" 204 0
2026-03-30 09:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_5387f28730c7a435f485e7a4dac131ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_e2688cb1052fb4bde420f93c4e4eb8be.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_41ef226267a719c3549721c604a258b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_cd27745678ebbba0058eab114f69b8ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_84d3433ec9d150c0facf5632c665edf5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_5a18b85af67f575142ba08341f058283.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fe6%252Ffae6336346de8803e78dbe1fcaa79ccc%252Fpa%252FDC35918_0dcc1dc46314c7b8172b8705010da075.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_0dcc1dc46314c7b8172b8705010da075.jpg not downloaded yet
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fe6%252Ffae6336346de8803e78dbe1fcaa79ccc%252Fpa%252FDC35918_038343570ce8a15ef0782083d8c4be2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_038343570ce8a15ef0782083d8c4be2e.jpg not downloaded yet
2026-03-30 09:04:30 [auto1.it] INFO: Channel: 24h | Page: 18 | totalHits: 3300 | hits on page: 40
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fe6%252Ffae6336346de8803e78dbe1fcaa79ccc%252Fpa%252FDC35918_563ea147ff9a6ad9f6214274946cca81.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_563ea147ff9a6ad9f6214274946cca81.jpg not downloaded yet
2026-03-30 09:04:30 [auto1.it] INFO: Found listing with ID: HW75415
2026-03-30 09:04:30 [auto1.it] INFO: Found listing with ID: NU75825
2026-03-30 09:04:30 [auto1.it] INFO: Found listing with ID: KV08617
2026-03-30 09:04:30 [auto1.it] INFO: Found listing with ID: EZ12998
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ12998%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [auto1.it] INFO: Scrape type for EZ12998: 2
2026-03-30 09:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9317958-a00d-52fd-a438-082c6a9e9745 with identifier: EZ12998
2026-03-30 09:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9317958-a00d-52fd-a438-082c6a9e9745 with scrape type 2
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9317958-a00d-52fd-a438-082c6a9e9745 with scrape type 2
2026-03-30 09:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d9317958-a00d-52fd-a438-082c6a9e9745, identifier: EZ12998
2026-03-30 09:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_3f8dc05a9242ae2b3d4cdc6c5e7e61fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fe6%252Ffae6336346de8803e78dbe1fcaa79ccc%252Fpa%252FDC35918_ad804ac1c910679b139612fd4017e3b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_ad804ac1c910679b139612fd4017e3b9.jpg not downloaded yet
2026-03-30 09:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d9317958-a00d-52fd-a438-082c6a9e9745 with identifier: EZ12998
2026-03-30 09:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d9317958-a00d-52fd-a438-082c6a9e9745 with identifier: EZ12998
2026-03-30 09:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d9317958-a00d-52fd-a438-082c6a9e9745 with identifier: EZ12998 to the API
2026-03-30 09:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:05:42Z',
 'fuel_type': 'electro',
 'id': 'd9317958-a00d-52fd-a438-082c6a9e9745',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ12998',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 31,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-27',
 'seller_name': None,
 'title': 'Peugeot 208 electric drive 100 kW Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2025}
2026-03-30 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ12998%27 HTTP/1.1" 200 None
2026-03-30 09:04:31 [auto1.it] INFO: Saving data for EZ12998: {'auction_closing_time': 1774969542.0, 'created_time': 1774429314.615706, 'last_price_update_time': 1774861471.552824}
2026-03-30 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ12998') HTTP/1.1" 204 0
2026-03-30 09:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_aa4f3f1e8d12143e94b748953e69e108.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_e2edde0b77da3ec4872bc8c3918f2c6b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:31 [auto1.it] INFO: Found listing with ID: NX89211
2026-03-30 09:04:31 [auto1.it] INFO: Found listing with ID: BV47322
2026-03-30 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV47322%27 HTTP/1.1" 200 None
2026-03-30 09:04:31 [auto1.it] INFO: Scrape type for BV47322: 2
2026-03-30 09:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d668db1a-f385-57b7-9ebd-ba008ca5b706 with identifier: BV47322
2026-03-30 09:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d668db1a-f385-57b7-9ebd-ba008ca5b706 with scrape type 2
2026-03-30 09:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d668db1a-f385-57b7-9ebd-ba008ca5b706 with scrape type 2
2026-03-30 09:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d668db1a-f385-57b7-9ebd-ba008ca5b706, identifier: BV47322
2026-03-30 09:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_153d068a5f180d7c000b29789a074a76.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_af23ccbbaef8dc8d3ff49793914e4977.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d668db1a-f385-57b7-9ebd-ba008ca5b706 with identifier: BV47322
2026-03-30 09:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d668db1a-f385-57b7-9ebd-ba008ca5b706 with identifier: BV47322
2026-03-30 09:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d668db1a-f385-57b7-9ebd-ba008ca5b706 with identifier: BV47322 to the API
2026-03-30 09:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:28:06Z',
 'fuel_type': 'electro',
 'id': 'd668db1a-f385-57b7-9ebd-ba008ca5b706',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV47322',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 9,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2026-02-24',
 'seller_name': None,
 'title': 'Peugeot 208 electric drive 100 kW Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2026}
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV47322%27 HTTP/1.1" 200 None
2026-03-30 09:04:32 [auto1.it] INFO: Saving data for BV47322: {'auction_closing_time': 1774970886.0, 'created_time': 1774515734.447148, 'last_price_update_time': 1774861472.078142}
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BV47322') HTTP/1.1" 204 0
2026-03-30 09:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c65110>
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_5387f28730c7a435f485e7a4dac131ca.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_5387f28730c7a435f485e7a4dac131ca.jpg saved to cache
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f285a5a3-e78b-506a-8610-2605f8cfaad4
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0610e390>
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_e2688cb1052fb4bde420f93c4e4eb8be.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_e2688cb1052fb4bde420f93c4e4eb8be.jpg saved to cache
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f285a5a3-e78b-506a-8610-2605f8cfaad4
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0c470390>
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_41ef226267a719c3549721c604a258b7.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_41ef226267a719c3549721c604a258b7.jpg saved to cache
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f285a5a3-e78b-506a-8610-2605f8cfaad4
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d43550>
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_cd27745678ebbba0058eab114f69b8ec.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_cd27745678ebbba0058eab114f69b8ec.jpg saved to cache
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f285a5a3-e78b-506a-8610-2605f8cfaad4
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d1308d0>
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_84d3433ec9d150c0facf5632c665edf5.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_84d3433ec9d150c0facf5632c665edf5.jpg saved to cache
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f285a5a3-e78b-506a-8610-2605f8cfaad4
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d067550>
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_5a18b85af67f575142ba08341f058283.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_5a18b85af67f575142ba08341f058283.jpg saved to cache
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f285a5a3-e78b-506a-8610-2605f8cfaad4
2026-03-30 09:04:32 [auto1.it] INFO: Found listing with ID: PR82970
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR82970%27 HTTP/1.1" 200 None
2026-03-30 09:04:32 [auto1.it] INFO: Scrape type for PR82970: 2
2026-03-30 09:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dc1ff36-823d-52e1-b924-26f46b14da37 with identifier: PR82970
2026-03-30 09:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dc1ff36-823d-52e1-b924-26f46b14da37 with scrape type 2
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dc1ff36-823d-52e1-b924-26f46b14da37 with scrape type 2
2026-03-30 09:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7dc1ff36-823d-52e1-b924-26f46b14da37, identifier: PR82970
2026-03-30 09:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_c3ef50b5f8a3096a9e59bdc5f40d7960.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7dc1ff36-823d-52e1-b924-26f46b14da37 with identifier: PR82970
2026-03-30 09:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7dc1ff36-823d-52e1-b924-26f46b14da37 with identifier: PR82970
2026-03-30 09:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7dc1ff36-823d-52e1-b924-26f46b14da37 with identifier: PR82970 to the API
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:01:03Z',
 'fuel_type': 'diesel',
 'id': '7dc1ff36-823d-52e1-b924-26f46b14da37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR82970',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 232417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-29',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 TDI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2009}
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR82970%27 HTTP/1.1" 200 None
2026-03-30 09:04:32 [auto1.it] INFO: Saving data for PR82970: {'auction_closing_time': 1774969263.0, 'created_time': 1772621720.775419, 'last_price_update_time': 1774861472.891052}
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR82970') HTTP/1.1" 204 0
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d80b90>
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F13%252Fa113944771a3a34d12afc9632981f6f2%252Fpa%252FDF99312_3f8dc05a9242ae2b3d4cdc6c5e7e61fd.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_3f8dc05a9242ae2b3d4cdc6c5e7e61fd.jpg saved to cache
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f285a5a3-e78b-506a-8610-2605f8cfaad4
2026-03-30 09:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f285a5a3-e78b-506a-8610-2605f8cfaad4, skipping ID generation
2026-03-30 09:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f285a5a3-e78b-506a-8610-2605f8cfaad4 with scrape type 1
2026-03-30 09:04:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f285a5a3-e78b-506a-8610-2605f8cfaad4 sending to next pipeline
2026-03-30 09:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f285a5a3-e78b-506a-8610-2605f8cfaad4, identifier: DF99312
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0633e9d0>
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_aa4f3f1e8d12143e94b748953e69e108.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_aa4f3f1e8d12143e94b748953e69e108.jpg saved to cache
2026-03-30 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d82850>
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_e2edde0b77da3ec4872bc8c3918f2c6b.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_e2edde0b77da3ec4872bc8c3918f2c6b.jpg saved to cache
2026-03-30 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92f89b02-df43-5f45-ac90-3ff36244603c
2026-03-30 09:04:33 [auto1.it] INFO: Found listing with ID: NN24552
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN24552%27 HTTP/1.1" 200 None
2026-03-30 09:04:33 [auto1.it] INFO: Scrape type for NN24552: 1
2026-03-30 09:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL99970> (referer: https://www.auto1.com/v1/car-details-view/FL99970/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f285a5a3-e78b-506a-8610-2605f8cfaad4 with identifier: DF99312
2026-03-30 09:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f285a5a3-e78b-506a-8610-2605f8cfaad4 with identifier: DF99312
2026-03-30 09:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f285a5a3-e78b-506a-8610-2605f8cfaad4 with identifier: DF99312 to the API
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_3f8dc05a9242ae2b3d4cdc6c5e7e61fd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:34:33Z',
 'fuel_type': 'diesel',
 'id': 'f285a5a3-e78b-506a-8610-2605f8cfaad4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF99312',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 190829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_3f8dc05a9242ae2b3d4cdc6c5e7e61fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_41ef226267a719c3549721c604a258b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_c29ece75578a94b3d8f01bb69b596db6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_5387f28730c7a435f485e7a4dac131ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_cd27745678ebbba0058eab114f69b8ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_bbe3756164eba5650854bf33e3001acc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_5a18b85af67f575142ba08341f058283.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_e2688cb1052fb4bde420f93c4e4eb8be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_27f983a9df6a12adf90f2d0c68ae1e92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f285a5a3-e78b-506a-8610-2605f8cfaad4/f285a5a3-e78b-506a-8610-2605f8cfaad4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/13/a113944771a3a34d12afc9632981f6f2/pa/DF99312_84d3433ec9d150c0facf5632c665edf5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF99312%27 HTTP/1.1" 200 None
2026-03-30 09:04:33 [auto1.it] INFO: Saving data for DF99312: {'created_time': 1774861473.548247, 'last_price_update_time': 1774861473.548257, 'auction_closing_time': 1774971273.0}
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DF99312') HTTP/1.1" 204 0
2026-03-30 09:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_0a86c1d85fd5d71dac00a7335df8a995.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062f2e10>
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_153d068a5f180d7c000b29789a074a76.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_153d068a5f180d7c000b29789a074a76.jpg saved to cache
2026-03-30 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062f1710>
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_af23ccbbaef8dc8d3ff49793914e4977.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_af23ccbbaef8dc8d3ff49793914e4977.jpg saved to cache
2026-03-30 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-03-30 09:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_397afbe7d655c54747fa990da6f7823a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_a0f432dd666c374157c89a7ae67c3366.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:33 [auto1.it] INFO: Found listing with ID: DD47357
2026-03-30 09:04:33 [auto1.it] INFO: Found listing with ID: GE66634
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE66634%27 HTTP/1.1" 200 None
2026-03-30 09:04:33 [auto1.it] INFO: Scrape type for GE66634: 1
2026-03-30 09:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:33 [auto1.it] INFO: Found listing with ID: EC84156
2026-03-30 09:04:33 [auto1.it] INFO: Found listing with ID: MJ25258
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ25258%27 HTTP/1.1" 200 None
2026-03-30 09:04:33 [auto1.it] INFO: Scrape type for MJ25258: 2
2026-03-30 09:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 873fa915-a719-5d46-b5b2-5f4c2340b3de with identifier: MJ25258
2026-03-30 09:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 873fa915-a719-5d46-b5b2-5f4c2340b3de with scrape type 2
2026-03-30 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 873fa915-a719-5d46-b5b2-5f4c2340b3de with scrape type 2
2026-03-30 09:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 873fa915-a719-5d46-b5b2-5f4c2340b3de, identifier: MJ25258
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dbf450>
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_c3ef50b5f8a3096a9e59bdc5f40d7960.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_c3ef50b5f8a3096a9e59bdc5f40d7960.jpg saved to cache
2026-03-30 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92f89b02-df43-5f45-ac90-3ff36244603c
2026-03-30 09:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aef16de-37ed-51fd-9a2d-02a471d48637 with identifier: FL99970
2026-03-30 09:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aef16de-37ed-51fd-9a2d-02a471d48637 with scrape type 1
2026-03-30 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0aef16de-37ed-51fd-9a2d-02a471d48637
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_a1207de1b8bb876662071fa6d9ab974b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_a1207de1b8bb876662071fa6d9ab974b.jpg not downloaded yet
2026-03-30 09:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 873fa915-a719-5d46-b5b2-5f4c2340b3de with identifier: MJ25258
2026-03-30 09:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 873fa915-a719-5d46-b5b2-5f4c2340b3de with identifier: MJ25258
2026-03-30 09:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 873fa915-a719-5d46-b5b2-5f4c2340b3de with identifier: MJ25258 to the API
2026-03-30 09:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:09:12Z',
 'fuel_type': 'electro',
 'id': '873fa915-a719-5d46-b5b2-5f4c2340b3de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ25258',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2026-02-24',
 'seller_name': None,
 'title': 'Peugeot 208 electric drive 100 kW e Active',
 'transmission': 'automatic',
 'trim': 'e Active',
 'year': 2026}
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ25258%27 HTTP/1.1" 200 None
2026-03-30 09:04:34 [auto1.it] INFO: Saving data for MJ25258: {'auction_closing_time': 1774969752.0, 'created_time': 1774515667.411389, 'last_price_update_time': 1774861474.170289}
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MJ25258') HTTP/1.1" 204 0
2026-03-30 09:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_ad804ac1c910679b139612fd4017e3b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:34 [auto1.it] INFO: Found listing with ID: WD60231
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD60231%27 HTTP/1.1" 200 None
2026-03-30 09:04:34 [auto1.it] INFO: Scrape type for WD60231: 2
2026-03-30 09:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a83dc8e6-6aca-5d29-a203-b0450d31500e with identifier: WD60231
2026-03-30 09:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a83dc8e6-6aca-5d29-a203-b0450d31500e with scrape type 2
2026-03-30 09:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a83dc8e6-6aca-5d29-a203-b0450d31500e with scrape type 2
2026-03-30 09:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a83dc8e6-6aca-5d29-a203-b0450d31500e, identifier: WD60231
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_7c101290c2f7696acd21e977cd46cd8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_7c101290c2f7696acd21e977cd46cd8f.jpg not downloaded yet
2026-03-30 09:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c18b90>
2026-03-30 09:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc805765-48a7-563a-a008-e7690e3c93d1/fc805765-48a7-563a-a008-e7690e3c93d1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fe6%252Ffae6336346de8803e78dbe1fcaa79ccc%252Fpa%252FDC35918_0a86c1d85fd5d71dac00a7335df8a995.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_0a86c1d85fd5d71dac00a7335df8a995.jpg saved to cache
2026-03-30 09:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc805765-48a7-563a-a008-e7690e3c93d1
2026-03-30 09:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_563ea147ff9a6ad9f6214274946cca81.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a83dc8e6-6aca-5d29-a203-b0450d31500e with identifier: WD60231
2026-03-30 09:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a83dc8e6-6aca-5d29-a203-b0450d31500e with identifier: WD60231
2026-03-30 09:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a83dc8e6-6aca-5d29-a203-b0450d31500e with identifier: WD60231 to the API
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:41:08Z',
 'fuel_type': 'diesel',
 'id': 'a83dc8e6-6aca-5d29-a203-b0450d31500e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD60231',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 118334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Sport Edition',
 'transmission': 'manual',
 'trim': 'Sport Edition',
 'year': 2018}
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD60231%27 HTTP/1.1" 200 None
2026-03-30 09:04:34 [auto1.it] INFO: Saving data for WD60231: {'auction_closing_time': 1774971668.0, 'created_time': 1774267253.376751, 'last_price_update_time': 1774861474.808105}
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WD60231') HTTP/1.1" 204 0
2026-03-30 09:04:34 [auto1.it] INFO: Found listing with ID: DX69970
2026-03-30 09:04:34 [auto1.it] INFO: Found listing with ID: SY68388
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY68388%27 HTTP/1.1" 200 None
2026-03-30 09:04:34 [auto1.it] INFO: Scrape type for SY68388: 1
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_104b6d8c5016de13769ab8ca0afe4a99.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_104b6d8c5016de13769ab8ca0afe4a99.jpg not downloaded yet
2026-03-30 09:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e22d10>
2026-03-30 09:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791b8b116079a142cf782791cb5158f%252Fpa%252FMA72760_397afbe7d655c54747fa990da6f7823a.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_397afbe7d655c54747fa990da6f7823a.jpg saved to cache
2026-03-30 09:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-03-30 09:04:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c8e1611-7aae-53be-b668-d7bc75c34ef5, skipping ID generation
2026-03-30 09:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5 with scrape type 1
2026-03-30 09:04:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5 sending to next pipeline
2026-03-30 09:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c8e1611-7aae-53be-b668-d7bc75c34ef5, identifier: MA72760
2026-03-30 09:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c307d0>
2026-03-30 09:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_a0f432dd666c374157c89a7ae67c3366.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_a0f432dd666c374157c89a7ae67c3366.jpg saved to cache
2026-03-30 09:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92f89b02-df43-5f45-ac90-3ff36244603c
2026-03-30 09:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c8e1611-7aae-53be-b668-d7bc75c34ef5 with identifier: MA72760
2026-03-30 09:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c8e1611-7aae-53be-b668-d7bc75c34ef5 with identifier: MA72760
2026-03-30 09:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c8e1611-7aae-53be-b668-d7bc75c34ef5 with identifier: MA72760 to the API
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_397afbe7d655c54747fa990da6f7823a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:54:16Z',
 'fuel_type': 'diesel',
 'id': '6c8e1611-7aae-53be-b668-d7bc75c34ef5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA72760',
 'listing': 'auction',
 'location': 'IT, Creazzo VI',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 200055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_5b224e70438699947c2484d98ba61afe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_397afbe7d655c54747fa990da6f7823a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_aa4f3f1e8d12143e94b748953e69e108.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c2ade1bde876d26b548b61e9e99ab059.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_4b1154cc1669d52272a78ed853f7a6c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_f194de2c5f1400ff8f71e7feb6c774c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c3e6d748b61429363873d5af0f689dd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_320a7043e9ab251284d5862c2f9adf86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_153d068a5f180d7c000b29789a074a76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_af23ccbbaef8dc8d3ff49793914e4977.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Executive Q4',
 'transmission': 'automatic',
 'trim': 'Executive Q4',
 'year': 2017}
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA72760%27 HTTP/1.1" 200 None
2026-03-30 09:04:35 [auto1.it] INFO: Saving data for MA72760: {'created_time': 1774861475.524887, 'last_price_update_time': 1774861475.524897, 'auction_closing_time': 1774972456.0}
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MA72760') HTTP/1.1" 204 0
2026-03-30 09:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_038343570ce8a15ef0782083d8c4be2e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:35 [auto1.it] INFO: Found listing with ID: KA52665
2026-03-30 09:04:35 [auto1.it] INFO: Found listing with ID: HL79864
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL79864%27 HTTP/1.1" 200 None
2026-03-30 09:04:35 [auto1.it] INFO: Scrape type for HL79864: 2
2026-03-30 09:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d79be7bc-3a2e-5f81-ade2-31dc3a03cf38 with identifier: HL79864
2026-03-30 09:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d79be7bc-3a2e-5f81-ade2-31dc3a03cf38 with scrape type 2
2026-03-30 09:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d79be7bc-3a2e-5f81-ade2-31dc3a03cf38 with scrape type 2
2026-03-30 09:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d79be7bc-3a2e-5f81-ade2-31dc3a03cf38, identifier: HL79864
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_fd6a4ab56ffc9ee43d91fa3b1bfa0ac2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_fd6a4ab56ffc9ee43d91fa3b1bfa0ac2.jpg not downloaded yet
2026-03-30 09:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d79be7bc-3a2e-5f81-ade2-31dc3a03cf38 with identifier: HL79864
2026-03-30 09:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d79be7bc-3a2e-5f81-ade2-31dc3a03cf38 with identifier: HL79864
2026-03-30 09:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d79be7bc-3a2e-5f81-ade2-31dc3a03cf38 with identifier: HL79864 to the API
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-31T15:06:36Z',
 'fuel_type': 'electro',
 'id': 'd79be7bc-3a2e-5f81-ade2-31dc3a03cf38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL79864',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Junior',
 'odometer': 87,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-19',
 'seller_name': None,
 'title': 'Alfa Romeo Junior electric drive 115 kW Speciale',
 'transmission': 'automatic',
 'trim': 'Speciale',
 'year': 2024}
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL79864%27 HTTP/1.1" 200 None
2026-03-30 09:04:35 [auto1.it] INFO: Saving data for HL79864: {'auction_closing_time': 1774969596.0, 'created_time': 1774386125.301348, 'last_price_update_time': 1774861475.988534}
2026-03-30 09:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HL79864') HTTP/1.1" 204 0
2026-03-30 09:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0625d5d0>
2026-03-30 09:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc805765-48a7-563a-a008-e7690e3c93d1/fc805765-48a7-563a-a008-e7690e3c93d1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fe6%252Ffae6336346de8803e78dbe1fcaa79ccc%252Fpa%252FDC35918_ad804ac1c910679b139612fd4017e3b9.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_ad804ac1c910679b139612fd4017e3b9.jpg saved to cache
2026-03-30 09:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc805765-48a7-563a-a008-e7690e3c93d1
2026-03-30 09:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ce0f90>
2026-03-30 09:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc805765-48a7-563a-a008-e7690e3c93d1/fc805765-48a7-563a-a008-e7690e3c93d1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fe6%252Ffae6336346de8803e78dbe1fcaa79ccc%252Fpa%252FDC35918_563ea147ff9a6ad9f6214274946cca81.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_563ea147ff9a6ad9f6214274946cca81.jpg saved to cache
2026-03-30 09:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc805765-48a7-563a-a008-e7690e3c93d1
2026-03-30 09:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_0dcc1dc46314c7b8172b8705010da075.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:36 [auto1.it] INFO: Found listing with ID: TM51427
2026-03-30 09:04:36 [auto1.it] INFO: Found listing with ID: NT07416
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT07416%27 HTTP/1.1" 200 None
2026-03-30 09:04:36 [auto1.it] INFO: Scrape type for NT07416: 2
2026-03-30 09:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02d140cd-7de7-54b6-b51c-34bb2ba1f092 with identifier: NT07416
2026-03-30 09:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02d140cd-7de7-54b6-b51c-34bb2ba1f092 with scrape type 2
2026-03-30 09:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02d140cd-7de7-54b6-b51c-34bb2ba1f092 with scrape type 2
2026-03-30 09:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 02d140cd-7de7-54b6-b51c-34bb2ba1f092, identifier: NT07416
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_b242fa6ef9baeb490572fbf1c8c443ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_b242fa6ef9baeb490572fbf1c8c443ae.jpg not downloaded yet
2026-03-30 09:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_6c81bdacf3b71f9d0bf1e5dcefcd7072.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 02d140cd-7de7-54b6-b51c-34bb2ba1f092 with identifier: NT07416
2026-03-30 09:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 02d140cd-7de7-54b6-b51c-34bb2ba1f092 with identifier: NT07416
2026-03-30 09:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 02d140cd-7de7-54b6-b51c-34bb2ba1f092 with identifier: NT07416 to the API
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:52:24Z',
 'fuel_type': 'diesel',
 'id': '02d140cd-7de7-54b6-b51c-34bb2ba1f092',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT07416',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 133759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-29',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.3 JTD Multijet Active',
 'transmission': 'manual',
 'trim': 'Multijet Active',
 'year': 2008}
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT07416%27 HTTP/1.1" 200 None
2026-03-30 09:04:37 [auto1.it] INFO: Saving data for NT07416: {'auction_closing_time': 1774972344.0, 'created_time': 1772778884.652295, 'last_price_update_time': 1774861477.044364}
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NT07416') HTTP/1.1" 204 0
2026-03-30 09:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dcd5d0>
2026-03-30 09:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc805765-48a7-563a-a008-e7690e3c93d1/fc805765-48a7-563a-a008-e7690e3c93d1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fe6%252Ffae6336346de8803e78dbe1fcaa79ccc%252Fpa%252FDC35918_038343570ce8a15ef0782083d8c4be2e.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_038343570ce8a15ef0782083d8c4be2e.jpg saved to cache
2026-03-30 09:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc805765-48a7-563a-a008-e7690e3c93d1
2026-03-30 09:04:37 [auto1.it] INFO: Found listing with ID: LY93977
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY93977%27 HTTP/1.1" 200 None
2026-03-30 09:04:37 [auto1.it] INFO: Scrape type for LY93977: 1
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_385f184d260a89d206ea90050547dfc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_385f184d260a89d206ea90050547dfc0.jpg not downloaded yet
2026-03-30 09:04:37 [auto1.it] INFO: Channel: 24h | Page: 19 | totalHits: 3300 | hits on page: 40
2026-03-30 09:04:37 [auto1.it] INFO: Found listing with ID: EY61657
2026-03-30 09:04:37 [auto1.it] INFO: Found listing with ID: WV93749
2026-03-30 09:04:37 [auto1.it] INFO: Found listing with ID: NR03781
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR03781%27 HTTP/1.1" 200 None
2026-03-30 09:04:37 [auto1.it] INFO: Scrape type for NR03781: 2
2026-03-30 09:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98ac2f07-3888-5de9-b79e-c50cd58e6af5 with identifier: NR03781
2026-03-30 09:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98ac2f07-3888-5de9-b79e-c50cd58e6af5 with scrape type 2
2026-03-30 09:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98ac2f07-3888-5de9-b79e-c50cd58e6af5 with scrape type 2
2026-03-30 09:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 98ac2f07-3888-5de9-b79e-c50cd58e6af5, identifier: NR03781
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_9f8ccaa63bd6ba1e010b62fb30c2b356.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_9f8ccaa63bd6ba1e010b62fb30c2b356.jpg not downloaded yet
2026-03-30 09:04:37 [auto1.it] INFO: Found listing with ID: HK60927
2026-03-30 09:04:37 [auto1.it] INFO: Found listing with ID: BD18129
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD18129%27 HTTP/1.1" 200 None
2026-03-30 09:04:37 [auto1.it] INFO: Scrape type for BD18129: 1
2026-03-30 09:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0cf31fd0>
2026-03-30 09:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc805765-48a7-563a-a008-e7690e3c93d1/fc805765-48a7-563a-a008-e7690e3c93d1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fe6%252Ffae6336346de8803e78dbe1fcaa79ccc%252Fpa%252FDC35918_0dcc1dc46314c7b8172b8705010da075.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_0dcc1dc46314c7b8172b8705010da075.jpg saved to cache
2026-03-30 09:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc805765-48a7-563a-a008-e7690e3c93d1
2026-03-30 09:04:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc805765-48a7-563a-a008-e7690e3c93d1, skipping ID generation
2026-03-30 09:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc805765-48a7-563a-a008-e7690e3c93d1 with scrape type 1
2026-03-30 09:04:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc805765-48a7-563a-a008-e7690e3c93d1 sending to next pipeline
2026-03-30 09:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fc805765-48a7-563a-a008-e7690e3c93d1, identifier: DC35918
2026-03-30 09:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d06f1d0>
2026-03-30 09:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_6c81bdacf3b71f9d0bf1e5dcefcd7072.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_6c81bdacf3b71f9d0bf1e5dcefcd7072.jpg saved to cache
2026-03-30 09:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92f89b02-df43-5f45-ac90-3ff36244603c
2026-03-30 09:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 98ac2f07-3888-5de9-b79e-c50cd58e6af5 with identifier: NR03781
2026-03-30 09:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 98ac2f07-3888-5de9-b79e-c50cd58e6af5 with identifier: NR03781
2026-03-30 09:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 98ac2f07-3888-5de9-b79e-c50cd58e6af5 with identifier: NR03781 to the API
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-31T15:38:10Z',
 'fuel_type': 'electro',
 'id': '98ac2f07-3888-5de9-b79e-c50cd58e6af5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR03781',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Junior',
 'odometer': 21,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-19',
 'seller_name': None,
 'title': 'Alfa Romeo Junior electric drive 115 kW Speciale',
 'transmission': 'automatic',
 'trim': 'Speciale',
 'year': 2024}
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR03781%27 HTTP/1.1" 200 None
2026-03-30 09:04:38 [auto1.it] INFO: Saving data for NR03781: {'auction_closing_time': 1774971490.0, 'created_time': 1774526606.053332, 'last_price_update_time': 1774861478.112624}
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR03781') HTTP/1.1" 204 0
2026-03-30 09:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fc805765-48a7-563a-a008-e7690e3c93d1 with identifier: DC35918
2026-03-30 09:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fc805765-48a7-563a-a008-e7690e3c93d1 with identifier: DC35918
2026-03-30 09:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fc805765-48a7-563a-a008-e7690e3c93d1 with identifier: DC35918 to the API
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_0dcc1dc46314c7b8172b8705010da075.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:33:14Z',
 'fuel_type': 'petrol',
 'id': 'fc805765-48a7-563a-a008-e7690e3c93d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC35918',
 'listing': 'auction',
 'location': 'IT, Pordenone',
 'make': 'Suzuki',
 'model': 'Splash',
 'odometer': 39065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc805765-48a7-563a-a008-e7690e3c93d1/fc805765-48a7-563a-a008-e7690e3c93d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_0a86c1d85fd5d71dac00a7335df8a995.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc805765-48a7-563a-a008-e7690e3c93d1/fc805765-48a7-563a-a008-e7690e3c93d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_0dcc1dc46314c7b8172b8705010da075.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc805765-48a7-563a-a008-e7690e3c93d1/fc805765-48a7-563a-a008-e7690e3c93d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_038343570ce8a15ef0782083d8c4be2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc805765-48a7-563a-a008-e7690e3c93d1/fc805765-48a7-563a-a008-e7690e3c93d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_563ea147ff9a6ad9f6214274946cca81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc805765-48a7-563a-a008-e7690e3c93d1/fc805765-48a7-563a-a008-e7690e3c93d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/e6/fae6336346de8803e78dbe1fcaa79ccc/pa/DC35918_ad804ac1c910679b139612fd4017e3b9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Splash 1.0 Basic',
 'transmission': 'manual',
 'trim': 'Basic',
 'year': 2011}
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC35918%27 HTTP/1.1" 200 None
2026-03-30 09:04:38 [auto1.it] INFO: Saving data for DC35918: {'created_time': 1774861478.619546, 'last_price_update_time': 1774861478.619559, 'auction_closing_time': 1774971194.0}
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DC35918') HTTP/1.1" 204 0
2026-03-30 09:04:38 [auto1.it] INFO: Found listing with ID: XX43378
2026-03-30 09:04:38 [auto1.it] INFO: Found listing with ID: HW21830
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW21830%27 HTTP/1.1" 200 None
2026-03-30 09:04:38 [auto1.it] INFO: Scrape type for HW21830: 2
2026-03-30 09:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be6f20dd-c9dc-5eb0-9f16-240bd2b4efa2 with identifier: HW21830
2026-03-30 09:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be6f20dd-c9dc-5eb0-9f16-240bd2b4efa2 with scrape type 2
2026-03-30 09:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be6f20dd-c9dc-5eb0-9f16-240bd2b4efa2 with scrape type 2
2026-03-30 09:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be6f20dd-c9dc-5eb0-9f16-240bd2b4efa2, identifier: HW21830
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_e383ebfe8cf93c8f567e09094a58a3db.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_e383ebfe8cf93c8f567e09094a58a3db.jpg not downloaded yet
2026-03-30 09:04:38 [auto1.it] INFO: Found listing with ID: UY94009
2026-03-30 09:04:38 [auto1.it] INFO: Found listing with ID: PP36077
2026-03-30 09:04:38 [auto1.it] INFO: Found listing with ID: AY28860
2026-03-30 09:04:38 [auto1.it] INFO: Found listing with ID: LE83570
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE83570%27 HTTP/1.1" 200 None
2026-03-30 09:04:38 [auto1.it] INFO: Scrape type for LE83570: 1
2026-03-30 09:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_a1207de1b8bb876662071fa6d9ab974b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be6f20dd-c9dc-5eb0-9f16-240bd2b4efa2 with identifier: HW21830
2026-03-30 09:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be6f20dd-c9dc-5eb0-9f16-240bd2b4efa2 with identifier: HW21830
2026-03-30 09:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be6f20dd-c9dc-5eb0-9f16-240bd2b4efa2 with identifier: HW21830 to the API
2026-03-30 09:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:20:23Z',
 'fuel_type': 'diesel',
 'id': 'be6f20dd-c9dc-5eb0-9f16-240bd2b4efa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW21830',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 109726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-11',
 'seller_name': None,
 'title': 'Citroen Jumper 2.0 Blue-HDi 33 L2H2',
 'transmission': 'manual',
 'trim': '33 L2H2',
 'year': 2019}
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW21830%27 HTTP/1.1" 200 None
2026-03-30 09:04:39 [auto1.it] INFO: Saving data for HW21830: {'auction_closing_time': 1774970423.0, 'created_time': 1774353912.277198, 'last_price_update_time': 1774861479.155352}
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW21830') HTTP/1.1" 204 0
2026-03-30 09:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN24552/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE66634/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_8af77ba566e76e14f2063495814ee429.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:39 [auto1.it] INFO: Found listing with ID: DJ29974
2026-03-30 09:04:39 [auto1.it] INFO: Found listing with ID: AK22038
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK22038%27 HTTP/1.1" 200 None
2026-03-30 09:04:39 [auto1.it] INFO: Scrape type for AK22038: 1
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_f45d60bf2404ba3b2c79d8f844ebfa51.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_f45d60bf2404ba3b2c79d8f844ebfa51.jpg not downloaded yet
2026-03-30 09:04:39 [auto1.it] INFO: Found listing with ID: RG24184
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG24184%27 HTTP/1.1" 200 None
2026-03-30 09:04:39 [auto1.it] INFO: Scrape type for RG24184: 2
2026-03-30 09:04:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86827616-505c-545e-b356-7ac98579dd26 with identifier: RG24184
2026-03-30 09:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86827616-505c-545e-b356-7ac98579dd26 with scrape type 2
2026-03-30 09:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86827616-505c-545e-b356-7ac98579dd26 with scrape type 2
2026-03-30 09:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 86827616-505c-545e-b356-7ac98579dd26, identifier: RG24184
2026-03-30 09:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 86827616-505c-545e-b356-7ac98579dd26 with identifier: RG24184
2026-03-30 09:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 86827616-505c-545e-b356-7ac98579dd26 with identifier: RG24184
2026-03-30 09:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 86827616-505c-545e-b356-7ac98579dd26 with identifier: RG24184 to the API
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:06:59Z',
 'fuel_type': 'diesel',
 'id': '86827616-505c-545e-b356-7ac98579dd26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG24184',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 234032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 Blue-HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2015}
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG24184%27 HTTP/1.1" 200 None
2026-03-30 09:04:39 [auto1.it] INFO: Saving data for RG24184: {'auction_closing_time': 1774969619.0, 'created_time': 1774267427.069841, 'last_price_update_time': 1774861479.663035}
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG24184') HTTP/1.1" 204 0
2026-03-30 09:04:39 [auto1.it] INFO: Found listing with ID: KH48340
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH48340%27 HTTP/1.1" 200 None
2026-03-30 09:04:39 [auto1.it] INFO: Scrape type for KH48340: 1
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_4d2a867ad06d68c8e4de3e8059976eb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_4d2a867ad06d68c8e4de3e8059976eb1.jpg not downloaded yet
2026-03-30 09:04:39 [auto1.it] INFO: Found listing with ID: KU84675
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU84675%27 HTTP/1.1" 200 None
2026-03-30 09:04:39 [auto1.it] INFO: Scrape type for KU84675: 1
2026-03-30 09:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_7c101290c2f7696acd21e977cd46cd8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ce3310>
2026-03-30 09:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_a1207de1b8bb876662071fa6d9ab974b.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_a1207de1b8bb876662071fa6d9ab974b.jpg saved to cache
2026-03-30 09:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0aef16de-37ed-51fd-9a2d-02a471d48637
2026-03-30 09:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062adad0>
2026-03-30 09:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_8af77ba566e76e14f2063495814ee429.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_8af77ba566e76e14f2063495814ee429.jpg saved to cache
2026-03-30 09:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65ca1c64-f026-5120-a52d-63732dd53d8e
2026-03-30 09:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_104b6d8c5016de13769ab8ca0afe4a99.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:39 [auto1.it] INFO: Found listing with ID: BV67922
2026-03-30 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV67922%27 HTTP/1.1" 200 None
2026-03-30 09:04:40 [auto1.it] INFO: Scrape type for BV67922: 2
2026-03-30 09:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfaacb14-3c9c-5e56-97c1-7651011bc14e with identifier: BV67922
2026-03-30 09:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfaacb14-3c9c-5e56-97c1-7651011bc14e with scrape type 2
2026-03-30 09:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfaacb14-3c9c-5e56-97c1-7651011bc14e with scrape type 2
2026-03-30 09:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dfaacb14-3c9c-5e56-97c1-7651011bc14e, identifier: BV67922
2026-03-30 09:04:40 [auto1.it] INFO: Found listing with ID: BW30944
2026-03-30 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW30944%27 HTTP/1.1" 200 None
2026-03-30 09:04:40 [auto1.it] INFO: Scrape type for BW30944: 1
2026-03-30 09:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dfaacb14-3c9c-5e56-97c1-7651011bc14e with identifier: BV67922
2026-03-30 09:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dfaacb14-3c9c-5e56-97c1-7651011bc14e with identifier: BV67922
2026-03-30 09:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dfaacb14-3c9c-5e56-97c1-7651011bc14e with identifier: BV67922 to the API
2026-03-30 09:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:39:05Z',
 'fuel_type': 'diesel',
 'id': 'dfaacb14-3c9c-5e56-97c1-7651011bc14e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV67922',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 111313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-26',
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H2 Start&Stop',
 'transmission': 'manual',
 'trim': '33 L2H2 Start&Stop',
 'year': 2021}
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV67922%27 HTTP/1.1" 200 None
2026-03-30 09:04:41 [auto1.it] INFO: Saving data for BV67922: {'auction_closing_time': 1774971545.0, 'created_time': 1774353986.886737, 'last_price_update_time': 1774861481.170281}
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BV67922') HTTP/1.1" 204 0
2026-03-30 09:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:41 [auto1.it] INFO: Found listing with ID: FJ09980
2026-03-30 09:04:41 [auto1.it] INFO: Found listing with ID: BG92234
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG92234%27 HTTP/1.1" 200 None
2026-03-30 09:04:41 [auto1.it] INFO: Scrape type for BG92234: 2
2026-03-30 09:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1024391b-dd1d-5ef6-8673-5fda18435f0e with identifier: BG92234
2026-03-30 09:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1024391b-dd1d-5ef6-8673-5fda18435f0e with scrape type 2
2026-03-30 09:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1024391b-dd1d-5ef6-8673-5fda18435f0e with scrape type 2
2026-03-30 09:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1024391b-dd1d-5ef6-8673-5fda18435f0e, identifier: BG92234
2026-03-30 09:04:41 [auto1.it] INFO: Found listing with ID: CV26562
2026-03-30 09:04:41 [auto1.it] INFO: Found listing with ID: YH66131
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH66131%27 HTTP/1.1" 200 None
2026-03-30 09:04:41 [auto1.it] INFO: Scrape type for YH66131: 1
2026-03-30 09:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY68388/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_fd6a4ab56ffc9ee43d91fa3b1bfa0ac2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1024391b-dd1d-5ef6-8673-5fda18435f0e with identifier: BG92234
2026-03-30 09:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1024391b-dd1d-5ef6-8673-5fda18435f0e with identifier: BG92234
2026-03-30 09:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1024391b-dd1d-5ef6-8673-5fda18435f0e with identifier: BG92234 to the API
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:37:06Z',
 'fuel_type': 'diesel',
 'id': '1024391b-dd1d-5ef6-8673-5fda18435f0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG92234',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 135613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 Multijet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2020}
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG92234%27 HTTP/1.1" 200 None
2026-03-30 09:04:41 [auto1.it] INFO: Saving data for BG92234: {'auction_closing_time': 1774971426.0, 'created_time': 1774353989.013193, 'last_price_update_time': 1774861481.792515}
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BG92234') HTTP/1.1" 204 0
2026-03-30 09:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dcec90>
2026-03-30 09:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_7c101290c2f7696acd21e977cd46cd8f.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_7c101290c2f7696acd21e977cd46cd8f.jpg saved to cache
2026-03-30 09:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0aef16de-37ed-51fd-9a2d-02a471d48637
2026-03-30 09:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f591d0>
2026-03-30 09:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_104b6d8c5016de13769ab8ca0afe4a99.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_104b6d8c5016de13769ab8ca0afe4a99.jpg saved to cache
2026-03-30 09:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0aef16de-37ed-51fd-9a2d-02a471d48637
2026-03-30 09:04:41 [auto1.it] INFO: Found listing with ID: UA98347
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA98347%27 HTTP/1.1" 200 None
2026-03-30 09:04:41 [auto1.it] INFO: Scrape type for UA98347: 2
2026-03-30 09:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aafc304a-5f27-50d9-8932-57bcfadaf2a9 with identifier: UA98347
2026-03-30 09:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aafc304a-5f27-50d9-8932-57bcfadaf2a9 with scrape type 2
2026-03-30 09:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aafc304a-5f27-50d9-8932-57bcfadaf2a9 with scrape type 2
2026-03-30 09:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aafc304a-5f27-50d9-8932-57bcfadaf2a9, identifier: UA98347
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: WU70120
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: TH98415
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: LE69865
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: AA15878
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: VF67541
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: DS14351
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: RA39852
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: LG90075
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG90075%27 HTTP/1.1" 200 None
2026-03-30 09:04:42 [auto1.it] INFO: Scrape type for LG90075: 1
2026-03-30 09:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aafc304a-5f27-50d9-8932-57bcfadaf2a9 with identifier: UA98347
2026-03-30 09:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aafc304a-5f27-50d9-8932-57bcfadaf2a9 with identifier: UA98347
2026-03-30 09:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aafc304a-5f27-50d9-8932-57bcfadaf2a9 with identifier: UA98347 to the API
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-31T15:41:49Z',
 'fuel_type': 'petrol',
 'id': 'aafc304a-5f27-50d9-8932-57bcfadaf2a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA98347',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 65440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seller_name': None,
 'title': 'Jeep Compass 1.5 GSE T4 e-Hybrid Limited FWD',
 'transmission': 'automatic',
 'trim': 'Limited FWD',
 'year': 2022}
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA98347%27 HTTP/1.1" 200 None
2026-03-30 09:04:42 [auto1.it] INFO: Saving data for UA98347: {'auction_closing_time': 1774971709.0, 'created_time': 1774602098.352277, 'last_price_update_time': 1774861482.440082}
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UA98347') HTTP/1.1" 204 0
2026-03-30 09:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_b242fa6ef9baeb490572fbf1c8c443ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: HP60897
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: LY78924
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: PZ75115
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ75115%27 HTTP/1.1" 200 None
2026-03-30 09:04:42 [auto1.it] INFO: Scrape type for PZ75115: 1
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: SB84815
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB84815%27 HTTP/1.1" 200 None
2026-03-30 09:04:42 [auto1.it] INFO: Scrape type for SB84815: 1
2026-03-30 09:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d950d0>
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_fd6a4ab56ffc9ee43d91fa3b1bfa0ac2.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_fd6a4ab56ffc9ee43d91fa3b1bfa0ac2.jpg saved to cache
2026-03-30 09:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0aef16de-37ed-51fd-9a2d-02a471d48637
2026-03-30 09:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_e383ebfe8cf93c8f567e09094a58a3db.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: GN40589
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: ET82005
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET82005%27 HTTP/1.1" 200 None
2026-03-30 09:04:42 [auto1.it] INFO: Scrape type for ET82005: 1
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: RV29599
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV29599%27 HTTP/1.1" 200 None
2026-03-30 09:04:42 [auto1.it] INFO: Scrape type for RV29599: 1
2026-03-30 09:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD18129/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_679ae4c5305a1af446042f0ae57dbdfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: UR67041
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR67041%27 HTTP/1.1" 200 None
2026-03-30 09:04:42 [auto1.it] INFO: Scrape type for UR67041: 1
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: AP46989
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: DC14157
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: SY71538
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: TV97878
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV97878%27 HTTP/1.1" 200 None
2026-03-30 09:04:42 [auto1.it] INFO: Scrape type for TV97878: 1
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f51ed0>
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_b242fa6ef9baeb490572fbf1c8c443ae.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_b242fa6ef9baeb490572fbf1c8c443ae.jpg saved to cache
2026-03-30 09:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0aef16de-37ed-51fd-9a2d-02a471d48637
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: XY85045
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: ZH20956
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH20956%27 HTTP/1.1" 200 None
2026-03-30 09:04:42 [auto1.it] INFO: Scrape type for ZH20956: 1
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: DY67923
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY67923%27 HTTP/1.1" 200 None
2026-03-30 09:04:42 [auto1.it] INFO: Scrape type for DY67923: 1
2026-03-30 09:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_9f8ccaa63bd6ba1e010b62fb30c2b356.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LE83570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: DU03202
2026-03-30 09:04:42 [auto1.it] INFO: Found listing with ID: RL27846
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL27846%27 HTTP/1.1" 200 None
2026-03-30 09:04:42 [auto1.it] INFO: Scrape type for RL27846: 1
2026-03-30 09:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd2a90>
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_e383ebfe8cf93c8f567e09094a58a3db.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_e383ebfe8cf93c8f567e09094a58a3db.jpg saved to cache
2026-03-30 09:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0aef16de-37ed-51fd-9a2d-02a471d48637
2026-03-30 09:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dbdb50>
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_679ae4c5305a1af446042f0ae57dbdfe.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_679ae4c5305a1af446042f0ae57dbdfe.jpg saved to cache
2026-03-30 09:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92f89b02-df43-5f45-ac90-3ff36244603c
2026-03-30 09:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_816d689a0cc7aa419a43b4a9bac8d77c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:43 [auto1.it] INFO: Found listing with ID: JT53783
2026-03-30 09:04:43 [auto1.it] INFO: Found listing with ID: PK93114
2026-03-30 09:04:43 [auto1.it] INFO: Found listing with ID: HS60673
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS60673%27 HTTP/1.1" 200 None
2026-03-30 09:04:43 [auto1.it] INFO: Scrape type for HS60673: 2
2026-03-30 09:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 948f937e-5450-51a5-aae3-44955796b6dd with identifier: HS60673
2026-03-30 09:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 948f937e-5450-51a5-aae3-44955796b6dd with scrape type 2
2026-03-30 09:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 948f937e-5450-51a5-aae3-44955796b6dd with scrape type 2
2026-03-30 09:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 948f937e-5450-51a5-aae3-44955796b6dd, identifier: HS60673
2026-03-30 09:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_f45d60bf2404ba3b2c79d8f844ebfa51.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 948f937e-5450-51a5-aae3-44955796b6dd with identifier: HS60673
2026-03-30 09:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 948f937e-5450-51a5-aae3-44955796b6dd with identifier: HS60673
2026-03-30 09:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 948f937e-5450-51a5-aae3-44955796b6dd with identifier: HS60673 to the API
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:58:51Z',
 'fuel_type': 'diesel',
 'id': '948f937e-5450-51a5-aae3-44955796b6dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS60673',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 163020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-06',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS60673%27 HTTP/1.1" 200 None
2026-03-30 09:04:43 [auto1.it] INFO: Saving data for HS60673: {'auction_closing_time': 1774972731.0, 'created_time': 1773404231.151093, 'last_price_update_time': 1774861483.627009}
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HS60673') HTTP/1.1" 204 0
2026-03-30 09:04:43 [auto1.it] INFO: Found listing with ID: GB15509
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB15509%27 HTTP/1.1" 200 None
2026-03-30 09:04:43 [auto1.it] INFO: Scrape type for GB15509: 1
2026-03-30 09:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fe5a90>
2026-03-30 09:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_9f8ccaa63bd6ba1e010b62fb30c2b356.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_9f8ccaa63bd6ba1e010b62fb30c2b356.jpg saved to cache
2026-03-30 09:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0aef16de-37ed-51fd-9a2d-02a471d48637
2026-03-30 09:04:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d2e710>
2026-03-30 09:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_816d689a0cc7aa419a43b4a9bac8d77c.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_816d689a0cc7aa419a43b4a9bac8d77c.jpg saved to cache
2026-03-30 09:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65ca1c64-f026-5120-a52d-63732dd53d8e
2026-03-30 09:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_e08e5ea49edec01155ba300f9f57cc2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:43 [auto1.it] INFO: Found listing with ID: YF83888
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF83888%27 HTTP/1.1" 200 None
2026-03-30 09:04:43 [auto1.it] INFO: Scrape type for YF83888: 1
2026-03-30 09:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE66634> (referer: https://www.auto1.com/v1/car-details-view/GE66634/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW30944/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN24552> (referer: https://www.auto1.com/v1/car-details-view/NN24552/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_f580f061a2d912f3cdbff376d54b2bef.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:43 [auto1.it] INFO: Found listing with ID: NM97698
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM97698%27 HTTP/1.1" 200 None
2026-03-30 09:04:43 [auto1.it] INFO: Scrape type for NM97698: 1
2026-03-30 09:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06304d50>
2026-03-30 09:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_f45d60bf2404ba3b2c79d8f844ebfa51.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_f45d60bf2404ba3b2c79d8f844ebfa51.jpg saved to cache
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0aef16de-37ed-51fd-9a2d-02a471d48637
2026-03-30 09:04:44 [auto1.it] INFO: Found listing with ID: WC79116
2026-03-30 09:04:44 [auto1.it] INFO: Found listing with ID: GA22711
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA22711%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [auto1.it] INFO: Scrape type for GA22711: 1
2026-03-30 09:04:44 [auto1.it] INFO: Found listing with ID: KT64542
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64542%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [auto1.it] INFO: Scrape type for KT64542: 2
2026-03-30 09:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddfa8fa4-3b25-5fe0-8f94-fa081d6730d7 with identifier: KT64542
2026-03-30 09:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddfa8fa4-3b25-5fe0-8f94-fa081d6730d7 with scrape type 2
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddfa8fa4-3b25-5fe0-8f94-fa081d6730d7 with scrape type 2
2026-03-30 09:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ddfa8fa4-3b25-5fe0-8f94-fa081d6730d7, identifier: KT64542
2026-03-30 09:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ddfa8fa4-3b25-5fe0-8f94-fa081d6730d7 with identifier: KT64542
2026-03-30 09:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ddfa8fa4-3b25-5fe0-8f94-fa081d6730d7 with identifier: KT64542
2026-03-30 09:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ddfa8fa4-3b25-5fe0-8f94-fa081d6730d7 with identifier: KT64542 to the API
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:21:00Z',
 'fuel_type': 'petrol',
 'id': 'ddfa8fa4-3b25-5fe0-8f94-fa081d6730d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT64542',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 150157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-20',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive pulse',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive pulse',
 'year': 2012}
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64542%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [auto1.it] INFO: Saving data for KT64542: {'auction_closing_time': 1774970460.0, 'created_time': 1773130673.1421, 'last_price_update_time': 1774861484.530319}
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT64542') HTTP/1.1" 204 0
2026-03-30 09:04:44 [auto1.it] INFO: Found listing with ID: VJ15098
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ15098%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [auto1.it] INFO: Scrape type for VJ15098: 1
2026-03-30 09:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c85490>
2026-03-30 09:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_e08e5ea49edec01155ba300f9f57cc2c.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_e08e5ea49edec01155ba300f9f57cc2c.jpg saved to cache
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65ca1c64-f026-5120-a52d-63732dd53d8e
2026-03-30 09:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_b8582f6c39712fc376e27b5765868896.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_305a8ef8ef92174416cc0189cb7347cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:44 [auto1.it] INFO: Found listing with ID: BP75996
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP75996%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [auto1.it] INFO: Scrape type for BP75996: 1
2026-03-30 09:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3894e5d6-f6df-53e3-89d9-a84134c634d2 with identifier: GE66634
2026-03-30 09:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3894e5d6-f6df-53e3-89d9-a84134c634d2 with scrape type 1
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3894e5d6-f6df-53e3-89d9-a84134c634d2
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_2052f672e546865870a1a2c839b88532.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_2052f672e546865870a1a2c839b88532.jpg not downloaded yet
2026-03-30 09:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49c28320-7a43-516b-a1e5-85ea52fa79d0 with identifier: NN24552
2026-03-30 09:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49c28320-7a43-516b-a1e5-85ea52fa79d0 with scrape type 1
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49c28320-7a43-516b-a1e5-85ea52fa79d0
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F20%252Faa20150415bba0e28eab1d31b02c8cc0%252Fpa%252FNN24552_57856395efdcf76ad185d21129ec0e33.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_57856395efdcf76ad185d21129ec0e33.jpg already downloaded
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F20%252Faa20150415bba0e28eab1d31b02c8cc0%252Fpa%252FNN24552_0fd954eb4734846f74ee845a7f4ade48.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_0fd954eb4734846f74ee845a7f4ade48.jpg already downloaded
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F20%252Faa20150415bba0e28eab1d31b02c8cc0%252Fpa%252FNN24552_e2d8c9bab2913e1b2bcc9eb51806114d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_e2d8c9bab2913e1b2bcc9eb51806114d.jpg already downloaded
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F20%252Faa20150415bba0e28eab1d31b02c8cc0%252Fpa%252FNN24552_ce28d77d4a54f8053fab58683532f75a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_ce28d77d4a54f8053fab58683532f75a.jpg already downloaded
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F20%252Faa20150415bba0e28eab1d31b02c8cc0%252Fpa%252FNN24552_69995f5c0f550e614c721b54c396bdf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_69995f5c0f550e614c721b54c396bdf6.jpg already downloaded
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F20%252Faa20150415bba0e28eab1d31b02c8cc0%252Fpa%252FNN24552_7b40afc3e1656d1b10e1ffbccd0dadfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_7b40afc3e1656d1b10e1ffbccd0dadfa.jpg already downloaded
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F20%252Faa20150415bba0e28eab1d31b02c8cc0%252Fpa%252FNN24552_f95e12c85e1a4beafbd489d2438ce52f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_f95e12c85e1a4beafbd489d2438ce52f.jpg already downloaded
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F20%252Faa20150415bba0e28eab1d31b02c8cc0%252Fpa%252FNN24552_d7c80deac2284a3ba0921a6718dbff18.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_d7c80deac2284a3ba0921a6718dbff18.jpg already downloaded
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F20%252Faa20150415bba0e28eab1d31b02c8cc0%252Fpa%252FNN24552_592bee5c1610427baebf95b923189203.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_592bee5c1610427baebf95b923189203.jpg already downloaded
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F20%252Faa20150415bba0e28eab1d31b02c8cc0%252Fpa%252FNN24552_d37147680260a099e257850c46f2f324.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_d37147680260a099e257850c46f2f324.jpg already downloaded
2026-03-30 09:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49c28320-7a43-516b-a1e5-85ea52fa79d0, identifier: NN24552
2026-03-30 09:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06389c90>
2026-03-30 09:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F79%252F0079e61d0c69b6032621a2b63d0b5fad%252Fpa%252FYM60630_f580f061a2d912f3cdbff376d54b2bef.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_f580f061a2d912f3cdbff376d54b2bef.jpg saved to cache
2026-03-30 09:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92f89b02-df43-5f45-ac90-3ff36244603c
2026-03-30 09:04:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92f89b02-df43-5f45-ac90-3ff36244603c, skipping ID generation
2026-03-30 09:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92f89b02-df43-5f45-ac90-3ff36244603c with scrape type 1
2026-03-30 09:04:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92f89b02-df43-5f45-ac90-3ff36244603c sending to next pipeline
2026-03-30 09:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 92f89b02-df43-5f45-ac90-3ff36244603c, identifier: YM60630
2026-03-30 09:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB84815/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49c28320-7a43-516b-a1e5-85ea52fa79d0 with identifier: NN24552
2026-03-30 09:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49c28320-7a43-516b-a1e5-85ea52fa79d0 with identifier: NN24552
2026-03-30 09:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49c28320-7a43-516b-a1e5-85ea52fa79d0 with identifier: NN24552 to the API
2026-03-30 09:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NN24552>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:30:10Z',
 'fuel_type': 'diesel',
 'id': '49c28320-7a43-516b-a1e5-85ea52fa79d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN24552',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'BMW',
 'model': '3er',
 'odometer': 253778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_57856395efdcf76ad185d21129ec0e33.jpg',
                'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_0fd954eb4734846f74ee845a7f4ade48.jpg',
                'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_e2d8c9bab2913e1b2bcc9eb51806114d.jpg',
                'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_ce28d77d4a54f8053fab58683532f75a.jpg',
                'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_69995f5c0f550e614c721b54c396bdf6.jpg',
                'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_7b40afc3e1656d1b10e1ffbccd0dadfa.jpg',
                'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_f95e12c85e1a4beafbd489d2438ce52f.jpg',
                'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_d7c80deac2284a3ba0921a6718dbff18.jpg',
                'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_592bee5c1610427baebf95b923189203.jpg',
                'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_d37147680260a099e257850c46f2f324.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c28320-7a43-516b-a1e5-85ea52fa79d0/49c28320-7a43-516b-a1e5-85ea52fa79d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_57856395efdcf76ad185d21129ec0e33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c28320-7a43-516b-a1e5-85ea52fa79d0/49c28320-7a43-516b-a1e5-85ea52fa79d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2590441,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_0fd954eb4734846f74ee845a7f4ade48.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c28320-7a43-516b-a1e5-85ea52fa79d0/49c28320-7a43-516b-a1e5-85ea52fa79d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2348173,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_e2d8c9bab2913e1b2bcc9eb51806114d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c28320-7a43-516b-a1e5-85ea52fa79d0/49c28320-7a43-516b-a1e5-85ea52fa79d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2676386,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_ce28d77d4a54f8053fab58683532f75a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c28320-7a43-516b-a1e5-85ea52fa79d0/49c28320-7a43-516b-a1e5-85ea52fa79d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_69995f5c0f550e614c721b54c396bdf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c28320-7a43-516b-a1e5-85ea52fa79d0/49c28320-7a43-516b-a1e5-85ea52fa79d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2384616,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_7b40afc3e1656d1b10e1ffbccd0dadfa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c28320-7a43-516b-a1e5-85ea52fa79d0/49c28320-7a43-516b-a1e5-85ea52fa79d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2429374,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_f95e12c85e1a4beafbd489d2438ce52f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c28320-7a43-516b-a1e5-85ea52fa79d0/49c28320-7a43-516b-a1e5-85ea52fa79d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2563568,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_d7c80deac2284a3ba0921a6718dbff18.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c28320-7a43-516b-a1e5-85ea52fa79d0/49c28320-7a43-516b-a1e5-85ea52fa79d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2557460,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_592bee5c1610427baebf95b923189203.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c28320-7a43-516b-a1e5-85ea52fa79d0/49c28320-7a43-516b-a1e5-85ea52fa79d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2622271,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/20/aa20150415bba0e28eab1d31b02c8cc0/pa/NN24552_d37147680260a099e257850c46f2f324.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN24552%27 HTTP/1.1" 200 None
2026-03-30 09:04:45 [auto1.it] INFO: Saving data for NN24552: {'created_time': 1774861485.744357, 'last_price_update_time': 1774861485.744369, 'auction_closing_time': 1774971010.0}
2026-03-30 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NN24552') HTTP/1.1" 204 0
2026-03-30 09:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 92f89b02-df43-5f45-ac90-3ff36244603c with identifier: YM60630
2026-03-30 09:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 92f89b02-df43-5f45-ac90-3ff36244603c with identifier: YM60630
2026-03-30 09:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 92f89b02-df43-5f45-ac90-3ff36244603c with identifier: YM60630 to the API
2026-03-30 09:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_f580f061a2d912f3cdbff376d54b2bef.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:04:59Z',
 'fuel_type': 'diesel',
 'id': '92f89b02-df43-5f45-ac90-3ff36244603c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM60630',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 219588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2693588,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_f580f061a2d912f3cdbff376d54b2bef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_a0f432dd666c374157c89a7ae67c3366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_c3ef50b5f8a3096a9e59bdc5f40d7960.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2359009,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_fffe03faaba3ae0abe08a77f19563b0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_7d1e5d4a93f92e96e6d53600e8db475a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2553188,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_6c81bdacf3b71f9d0bf1e5dcefcd7072.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2672339,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_62871d575406c5216e131cff7ad3194e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703057,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_673fdc27bfcdaecae2d2f40ada72d47b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2613696,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_679ae4c5305a1af446042f0ae57dbdfe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f89b02-df43-5f45-ac90-3ff36244603c/92f89b02-df43-5f45-ac90-3ff36244603c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/79/0079e61d0c69b6032621a2b63d0b5fad/pa/YM60630_e2edde0b77da3ec4872bc8c3918f2c6b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM60630%27 HTTP/1.1" 200 None
2026-03-30 09:04:46 [auto1.it] INFO: Saving data for YM60630: {'created_time': 1774861486.153854, 'last_price_update_time': 1774861486.153865, 'auction_closing_time': 1774969499.0}
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YM60630') HTTP/1.1" 204 0
2026-03-30 09:04:46 [auto1.it] INFO: Found listing with ID: YP88006
2026-03-30 09:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_80f0da8a3d9a74f19d30de45f0c9f7c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_80f0da8a3d9a74f19d30de45f0c9f7c5.jpg not downloaded yet
2026-03-30 09:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV29599/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY68388> (referer: https://www.auto1.com/v1/car-details-view/SY68388/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06139e50>
2026-03-30 09:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_b8582f6c39712fc376e27b5765868896.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_b8582f6c39712fc376e27b5765868896.jpg saved to cache
2026-03-30 09:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65ca1c64-f026-5120-a52d-63732dd53d8e
2026-03-30 09:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06397c50>
2026-03-30 09:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F34%252Fbb34d1ee03ffa0497e6d27c2b7c8be63%252Fpa%252FSR04366_305a8ef8ef92174416cc0189cb7347cb.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_305a8ef8ef92174416cc0189cb7347cb.jpg saved to cache
2026-03-30 09:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65ca1c64-f026-5120-a52d-63732dd53d8e
2026-03-30 09:04:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65ca1c64-f026-5120-a52d-63732dd53d8e, skipping ID generation
2026-03-30 09:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ca1c64-f026-5120-a52d-63732dd53d8e with scrape type 1
2026-03-30 09:04:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65ca1c64-f026-5120-a52d-63732dd53d8e sending to next pipeline
2026-03-30 09:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 65ca1c64-f026-5120-a52d-63732dd53d8e, identifier: SR04366
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_128809914087a8d2bd16da7cb6d4064d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_128809914087a8d2bd16da7cb6d4064d.jpg not downloaded yet
2026-03-30 09:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG90075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 65ca1c64-f026-5120-a52d-63732dd53d8e with identifier: SR04366
2026-03-30 09:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 65ca1c64-f026-5120-a52d-63732dd53d8e with identifier: SR04366
2026-03-30 09:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 65ca1c64-f026-5120-a52d-63732dd53d8e with identifier: SR04366 to the API
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_305a8ef8ef92174416cc0189cb7347cb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '3.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:32:42Z',
 'fuel_type': 'diesel',
 'id': '65ca1c64-f026-5120-a52d-63732dd53d8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR04366',
 'listing': 'auction',
 'location': 'IT, Varese',
 'make': 'Toyota',
 'model': 'Land Cruiser',
 'odometer': 305768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_618474d29e47c1ae58e9da4577736d35.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2739587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_bddfa032b71e6b623121a0b0a7d7420e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2585859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_a9c1130876d366cf6e43ad06dd759412.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2839742,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_404ce6397011bc6ea2b71509f579e0e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2535236,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_b8582f6c39712fc376e27b5765868896.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2667575,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_305a8ef8ef92174416cc0189cb7347cb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2794887,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_e08e5ea49edec01155ba300f9f57cc2c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2648895,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_816d689a0cc7aa419a43b4a9bac8d77c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2569134,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_15b6ad6d243fde81ed831933baf68cff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca1c64-f026-5120-a52d-63732dd53d8e/65ca1c64-f026-5120-a52d-63732dd53d8e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2998844,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/34/bb34d1ee03ffa0497e6d27c2b7c8be63/pa/SR04366_8af77ba566e76e14f2063495814ee429.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1998-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Land Cruiser 3.0 Turbodiesel',
 'transmission': 'manual',
 'trim': '',
 'year': 1998}
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR04366%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [auto1.it] INFO: Saving data for SR04366: {'created_time': 1774861487.084645, 'last_price_update_time': 1774861487.084656, 'auction_closing_time': 1774971162.0}
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SR04366') HTTP/1.1" 204 0
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_688b3bbd71f5d340b3352eeebdd93b6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_688b3bbd71f5d340b3352eeebdd93b6a.jpg not downloaded yet
2026-03-30 09:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD18129> (referer: https://www.auto1.com/v1/car-details-view/BD18129/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY67923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f285b5e-287c-5b36-81f7-13f383e6dcde with identifier: SY68388
2026-03-30 09:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f285b5e-287c-5b36-81f7-13f383e6dcde with scrape type 1
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f285b5e-287c-5b36-81f7-13f383e6dcde
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_baf17e44c6484e18c3339b6743ca66f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_baf17e44c6484e18c3339b6743ca66f9.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_e3df93f65c076b720b5fdd0b87d90b61.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_e3df93f65c076b720b5fdd0b87d90b61.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_b9ba5f1b0a9a645e0e2fb5a73b71b5d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_b9ba5f1b0a9a645e0e2fb5a73b71b5d6.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_1849ed482acd5a82fad60c3b4c23f69a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_1849ed482acd5a82fad60c3b4c23f69a.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_dc80e3d00d36f1ea695cfc2e4791e11e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_dc80e3d00d36f1ea695cfc2e4791e11e.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_961526ea95845298a5a253c18970982b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_961526ea95845298a5a253c18970982b.jpg not downloaded yet
2026-03-30 09:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_2052f672e546865870a1a2c839b88532.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_128809914087a8d2bd16da7cb6d4064d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_80f0da8a3d9a74f19d30de45f0c9f7c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_e4d580fa08bdbec24f50410952500091.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_e4d580fa08bdbec24f50410952500091.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_e85b095002c5312ce11d2922af750651.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_e85b095002c5312ce11d2922af750651.jpg not downloaded yet
2026-03-30 09:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7005b13-c60f-5c0b-8bb1-128a46e03f89 with identifier: BD18129
2026-03-30 09:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7005b13-c60f-5c0b-8bb1-128a46e03f89 with scrape type 1
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_ddd6f1357ba294b2bd231f5ca3e175b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_ddd6f1357ba294b2bd231f5ca3e175b7.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_eb07c5ae84ba800aa443c005e7208294.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_eb07c5ae84ba800aa443c005e7208294.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_7d2948316c947dca25ba4cea8cb893f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_7d2948316c947dca25ba4cea8cb893f2.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_545e13fadfe577529da51540fad9ca38.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_545e13fadfe577529da51540fad9ca38.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_e964915b2dc3f3ced81aebb0b852a87d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_e964915b2dc3f3ced81aebb0b852a87d.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_3f3df36a5fd529039d9b263d45306641.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_3f3df36a5fd529039d9b263d45306641.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_4916ab39fc725a87a7d0b3b22d13eca8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_4916ab39fc725a87a7d0b3b22d13eca8.jpg not downloaded yet
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e9b650>
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_2052f672e546865870a1a2c839b88532.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_2052f672e546865870a1a2c839b88532.jpg saved to cache
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3894e5d6-f6df-53e3-89d9-a84134c634d2
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0619a590>
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_128809914087a8d2bd16da7cb6d4064d.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_128809914087a8d2bd16da7cb6d4064d.jpg saved to cache
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3894e5d6-f6df-53e3-89d9-a84134c634d2
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d19490>
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_80f0da8a3d9a74f19d30de45f0c9f7c5.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_80f0da8a3d9a74f19d30de45f0c9f7c5.jpg saved to cache
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3894e5d6-f6df-53e3-89d9-a84134c634d2
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_7fd2c625e279bbded1e516487adaccf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_7fd2c625e279bbded1e516487adaccf3.jpg not downloaded yet
2026-03-30 09:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_1849ed482acd5a82fad60c3b4c23f69a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_addd01110743fbe9636f49725018b908.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_addd01110743fbe9636f49725018b908.jpg not downloaded yet
2026-03-30 09:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_b9ba5f1b0a9a645e0e2fb5a73b71b5d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_4e5b57169b1e7d71c61dbde42ca20568.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_4e5b57169b1e7d71c61dbde42ca20568.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_5ad90f17a61fdcb8af4a03d6855a3022.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_5ad90f17a61fdcb8af4a03d6855a3022.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_753d9df1ac095736f9cd40382979c1b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_753d9df1ac095736f9cd40382979c1b1.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_c8c82dfe1c45e7f72dcbfbf8e765a3ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_c8c82dfe1c45e7f72dcbfbf8e765a3ce.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_b92126f388f813057d9ffae15d97905d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_b92126f388f813057d9ffae15d97905d.jpg not downloaded yet
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_391704cdb0129d09303c080657847844.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_391704cdb0129d09303c080657847844.jpg not downloaded yet
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d53550>
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_1849ed482acd5a82fad60c3b4c23f69a.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_1849ed482acd5a82fad60c3b4c23f69a.jpg saved to cache
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3894e5d6-f6df-53e3-89d9-a84134c634d2
2026-03-30 09:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_4916ab39fc725a87a7d0b3b22d13eca8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_260f9e62f1a0f55c992112e402f2a307.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_260f9e62f1a0f55c992112e402f2a307.jpg not downloaded yet
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062f2e10>
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_b9ba5f1b0a9a645e0e2fb5a73b71b5d6.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_b9ba5f1b0a9a645e0e2fb5a73b71b5d6.jpg saved to cache
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f285b5e-287c-5b36-81f7-13f383e6dcde
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_8562bb8cbe36bffbd6bd568d9ec6803b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_8562bb8cbe36bffbd6bd568d9ec6803b.jpg not downloaded yet
2026-03-30 09:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH20956/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_08cb586b8b0486f1c8874952308498eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_08cb586b8b0486f1c8874952308498eb.jpg not downloaded yet
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f5b950>
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_4916ab39fc725a87a7d0b3b22d13eca8.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_4916ab39fc725a87a7d0b3b22d13eca8.jpg saved to cache
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-03-30 09:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_dc80e3d00d36f1ea695cfc2e4791e11e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_7fd2c625e279bbded1e516487adaccf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e37fd0>
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_dc80e3d00d36f1ea695cfc2e4791e11e.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_dc80e3d00d36f1ea695cfc2e4791e11e.jpg saved to cache
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f285b5e-287c-5b36-81f7-13f383e6dcde
2026-03-30 09:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_391704cdb0129d09303c080657847844.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_08cb586b8b0486f1c8874952308498eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_260f9e62f1a0f55c992112e402f2a307.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_8562bb8cbe36bffbd6bd568d9ec6803b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e21fd0>
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_7fd2c625e279bbded1e516487adaccf3.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_7fd2c625e279bbded1e516487adaccf3.jpg saved to cache
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f285b5e-287c-5b36-81f7-13f383e6dcde
2026-03-30 09:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ15098/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW30944> (referer: https://www.auto1.com/v1/car-details-view/BW30944/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM97698/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c61010>
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_391704cdb0129d09303c080657847844.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_391704cdb0129d09303c080657847844.jpg saved to cache
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06192850>
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_08cb586b8b0486f1c8874952308498eb.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_08cb586b8b0486f1c8874952308498eb.jpg saved to cache
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ec7b50>
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_260f9e62f1a0f55c992112e402f2a307.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_260f9e62f1a0f55c992112e402f2a307.jpg saved to cache
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fcfb10>
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_8562bb8cbe36bffbd6bd568d9ec6803b.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_8562bb8cbe36bffbd6bd568d9ec6803b.jpg saved to cache
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-03-30 09:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_c8c82dfe1c45e7f72dcbfbf8e765a3ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02c01cf9-c762-58a2-ac7d-2b0c454825c5 with identifier: BW30944
2026-03-30 09:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02c01cf9-c762-58a2-ac7d-2b0c454825c5 with scrape type 1
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02c01cf9-c762-58a2-ac7d-2b0c454825c5
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe0%252F94e069a304e0b52ee8e40c7d4d8abfa9%252Fpa%252FBW30944_cff82a77107a587ebc48e0a9bebec3d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_cff82a77107a587ebc48e0a9bebec3d3.jpg already downloaded
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe0%252F94e069a304e0b52ee8e40c7d4d8abfa9%252Fpa%252FBW30944_cb024ca9606aea17a51b2305ab8aea08.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_cb024ca9606aea17a51b2305ab8aea08.jpg already downloaded
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe0%252F94e069a304e0b52ee8e40c7d4d8abfa9%252Fpa%252FBW30944_0695cb518bce3aec1942294b7a89ce1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_0695cb518bce3aec1942294b7a89ce1a.jpg already downloaded
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe0%252F94e069a304e0b52ee8e40c7d4d8abfa9%252Fpa%252FBW30944_de895fa3bfa2e3bc0e544cba4b02eb3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_de895fa3bfa2e3bc0e544cba4b02eb3a.jpg already downloaded
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe0%252F94e069a304e0b52ee8e40c7d4d8abfa9%252Fpa%252FBW30944_e2ab2a9197f4dcfb1680c20cea354da9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_e2ab2a9197f4dcfb1680c20cea354da9.jpg already downloaded
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe0%252F94e069a304e0b52ee8e40c7d4d8abfa9%252Fpa%252FBW30944_351adca2ebb894833d31ed794a2ec2dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_351adca2ebb894833d31ed794a2ec2dc.jpg already downloaded
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe0%252F94e069a304e0b52ee8e40c7d4d8abfa9%252Fpa%252FBW30944_b4eb0c192f3bceba665571d9d05916d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_b4eb0c192f3bceba665571d9d05916d8.jpg already downloaded
2026-03-30 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe0%252F94e069a304e0b52ee8e40c7d4d8abfa9%252Fpa%252FBW30944_ace5ec8bfc5fcc28f0bac0a550f74c96.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_ace5ec8bfc5fcc28f0bac0a550f74c96.jpg already downloaded
2026-03-30 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe0%252F94e069a304e0b52ee8e40c7d4d8abfa9%252Fpa%252FBW30944_bf511d49e77bbbc9dd69ef40ac083f91.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_bf511d49e77bbbc9dd69ef40ac083f91.jpg already downloaded
2026-03-30 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe0%252F94e069a304e0b52ee8e40c7d4d8abfa9%252Fpa%252FBW30944_a2a691d27ae9bc834aa0470febf099f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_a2a691d27ae9bc834aa0470febf099f0.jpg already downloaded
2026-03-30 09:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 02c01cf9-c762-58a2-ac7d-2b0c454825c5, identifier: BW30944
2026-03-30 09:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL27846/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 02c01cf9-c762-58a2-ac7d-2b0c454825c5 with identifier: BW30944
2026-03-30 09:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 02c01cf9-c762-58a2-ac7d-2b0c454825c5 with identifier: BW30944
2026-03-30 09:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 02c01cf9-c762-58a2-ac7d-2b0c454825c5 with identifier: BW30944 to the API
2026-03-30 09:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BW30944>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:11:46Z',
 'fuel_type': 'diesel',
 'id': '02c01cf9-c762-58a2-ac7d-2b0c454825c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW30944',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 196437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_cff82a77107a587ebc48e0a9bebec3d3.jpg',
                'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_cb024ca9606aea17a51b2305ab8aea08.jpg',
                'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_0695cb518bce3aec1942294b7a89ce1a.jpg',
                'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_de895fa3bfa2e3bc0e544cba4b02eb3a.jpg',
                'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_e2ab2a9197f4dcfb1680c20cea354da9.jpg',
                'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_351adca2ebb894833d31ed794a2ec2dc.jpg',
                'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_b4eb0c192f3bceba665571d9d05916d8.jpg',
                'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_ace5ec8bfc5fcc28f0bac0a550f74c96.jpg',
                'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_bf511d49e77bbbc9dd69ef40ac083f91.jpg',
                'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_a2a691d27ae9bc834aa0470febf099f0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c01cf9-c762-58a2-ac7d-2b0c454825c5/02c01cf9-c762-58a2-ac7d-2b0c454825c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_cff82a77107a587ebc48e0a9bebec3d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c01cf9-c762-58a2-ac7d-2b0c454825c5/02c01cf9-c762-58a2-ac7d-2b0c454825c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_cb024ca9606aea17a51b2305ab8aea08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c01cf9-c762-58a2-ac7d-2b0c454825c5/02c01cf9-c762-58a2-ac7d-2b0c454825c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_0695cb518bce3aec1942294b7a89ce1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c01cf9-c762-58a2-ac7d-2b0c454825c5/02c01cf9-c762-58a2-ac7d-2b0c454825c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_de895fa3bfa2e3bc0e544cba4b02eb3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c01cf9-c762-58a2-ac7d-2b0c454825c5/02c01cf9-c762-58a2-ac7d-2b0c454825c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_e2ab2a9197f4dcfb1680c20cea354da9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c01cf9-c762-58a2-ac7d-2b0c454825c5/02c01cf9-c762-58a2-ac7d-2b0c454825c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_351adca2ebb894833d31ed794a2ec2dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c01cf9-c762-58a2-ac7d-2b0c454825c5/02c01cf9-c762-58a2-ac7d-2b0c454825c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_b4eb0c192f3bceba665571d9d05916d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c01cf9-c762-58a2-ac7d-2b0c454825c5/02c01cf9-c762-58a2-ac7d-2b0c454825c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_ace5ec8bfc5fcc28f0bac0a550f74c96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c01cf9-c762-58a2-ac7d-2b0c454825c5/02c01cf9-c762-58a2-ac7d-2b0c454825c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_bf511d49e77bbbc9dd69ef40ac083f91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c01cf9-c762-58a2-ac7d-2b0c454825c5/02c01cf9-c762-58a2-ac7d-2b0c454825c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e0/94e069a304e0b52ee8e40c7d4d8abfa9/pa/BW30944_a2a691d27ae9bc834aa0470febf099f0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid R-dynamic S',
 'transmission': 'automatic',
 'trim': 'R-dynamic S',
 'year': 2019}
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW30944%27 HTTP/1.1" 200 None
2026-03-30 09:04:50 [auto1.it] INFO: Saving data for BW30944: {'created_time': 1774861490.702594, 'last_price_update_time': 1774861490.702605, 'auction_closing_time': 1774969906.0}
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BW30944') HTTP/1.1" 204 0
2026-03-30 09:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_5ad90f17a61fdcb8af4a03d6855a3022.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_addd01110743fbe9636f49725018b908.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF83888/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP75996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA22711/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06364850>
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_c8c82dfe1c45e7f72dcbfbf8e765a3ce.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_c8c82dfe1c45e7f72dcbfbf8e765a3ce.jpg saved to cache
2026-03-30 09:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-03-30 09:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_3f3df36a5fd529039d9b263d45306641.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cc9d90>
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_5ad90f17a61fdcb8af4a03d6855a3022.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_5ad90f17a61fdcb8af4a03d6855a3022.jpg saved to cache
2026-03-30 09:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061927d0>
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_addd01110743fbe9636f49725018b908.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_addd01110743fbe9636f49725018b908.jpg saved to cache
2026-03-30 09:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-03-30 09:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_7d2948316c947dca25ba4cea8cb893f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_753d9df1ac095736f9cd40382979c1b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_545e13fadfe577529da51540fad9ca38.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:50 [auto1.it] INFO: Channel: 24h | Page: 20 | totalHits: 3301 | hits on page: 40
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061d7a90>
2026-03-30 09:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_3f3df36a5fd529039d9b263d45306641.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_3f3df36a5fd529039d9b263d45306641.jpg saved to cache
2026-03-30 09:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3894e5d6-f6df-53e3-89d9-a84134c634d2
2026-03-30 09:04:51 [auto1.it] INFO: Found listing with ID: YP88006
2026-03-30 09:04:51 [auto1.it] INFO: Found listing with ID: DA03444
2026-03-30 09:04:51 [auto1.it] INFO: Found listing with ID: ZJ84308
2026-03-30 09:04:51 [auto1.it] INFO: Found listing with ID: JX77984
2026-03-30 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX77984%27 HTTP/1.1" 200 None
2026-03-30 09:04:51 [auto1.it] INFO: Scrape type for JX77984: 2
2026-03-30 09:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99b6e6ac-3f43-552d-a6d1-79c10cb7267c with identifier: JX77984
2026-03-30 09:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99b6e6ac-3f43-552d-a6d1-79c10cb7267c with scrape type 2
2026-03-30 09:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99b6e6ac-3f43-552d-a6d1-79c10cb7267c with scrape type 2
2026-03-30 09:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 99b6e6ac-3f43-552d-a6d1-79c10cb7267c, identifier: JX77984
2026-03-30 09:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_4e5b57169b1e7d71c61dbde42ca20568.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 99b6e6ac-3f43-552d-a6d1-79c10cb7267c with identifier: JX77984
2026-03-30 09:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 99b6e6ac-3f43-552d-a6d1-79c10cb7267c with identifier: JX77984
2026-03-30 09:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 99b6e6ac-3f43-552d-a6d1-79c10cb7267c with identifier: JX77984 to the API
2026-03-30 09:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 151,
 'expiration_date': '2026-03-31T15:13:09Z',
 'fuel_type': 'petrol',
 'id': '99b6e6ac-3f43-552d-a6d1-79c10cb7267c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX77984',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 64519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-27',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 Turbo S-Design Cross',
 'transmission': 'automatic',
 'trim': 'S-Design Cross',
 'year': 2020}
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX77984%27 HTTP/1.1" 200 None
2026-03-30 09:04:52 [auto1.it] INFO: Saving data for JX77984: {'auction_closing_time': 1774969989.0, 'created_time': 1774515726.944078, 'last_price_update_time': 1774861492.197301}
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JX77984') HTTP/1.1" 204 0
2026-03-30 09:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_eb07c5ae84ba800aa443c005e7208294.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:52 [auto1.it] INFO: Found listing with ID: WA94787
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA94787%27 HTTP/1.1" 200 None
2026-03-30 09:04:52 [auto1.it] INFO: Scrape type for WA94787: 1
2026-03-30 09:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV97878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06390310>
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_7d2948316c947dca25ba4cea8cb893f2.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_7d2948316c947dca25ba4cea8cb893f2.jpg saved to cache
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3894e5d6-f6df-53e3-89d9-a84134c634d2
2026-03-30 09:04:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0611b650>
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_753d9df1ac095736f9cd40382979c1b1.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_753d9df1ac095736f9cd40382979c1b1.jpg saved to cache
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f285b5e-287c-5b36-81f7-13f383e6dcde
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c54250>
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_545e13fadfe577529da51540fad9ca38.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_545e13fadfe577529da51540fad9ca38.jpg saved to cache
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-03-30 09:04:52 [auto1.it] INFO: Found listing with ID: AN65635
2026-03-30 09:04:52 [auto1.it] INFO: Found listing with ID: ER60323
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER60323%27 HTTP/1.1" 200 None
2026-03-30 09:04:52 [auto1.it] INFO: Scrape type for ER60323: 1
2026-03-30 09:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB84815> (referer: https://www.auto1.com/v1/car-details-view/SB84815/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LE83570> (referer: https://www.auto1.com/v1/car-details-view/LE83570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB15509/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_b92126f388f813057d9ffae15d97905d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d06e950>
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_4e5b57169b1e7d71c61dbde42ca20568.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_4e5b57169b1e7d71c61dbde42ca20568.jpg saved to cache
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f285b5e-287c-5b36-81f7-13f383e6dcde
2026-03-30 09:04:52 [auto1.it] INFO: Found listing with ID: ZC12877
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC12877%27 HTTP/1.1" 200 None
2026-03-30 09:04:52 [auto1.it] INFO: Scrape type for ZC12877: 1
2026-03-30 09:04:52 [auto1.it] INFO: Found listing with ID: YT71636
2026-03-30 09:04:52 [auto1.it] INFO: Found listing with ID: TC55039
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC55039%27 HTTP/1.1" 200 None
2026-03-30 09:04:52 [auto1.it] INFO: Scrape type for TC55039: 1
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fe4490>
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_eb07c5ae84ba800aa443c005e7208294.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_eb07c5ae84ba800aa443c005e7208294.jpg saved to cache
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f285b5e-287c-5b36-81f7-13f383e6dcde
2026-03-30 09:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e61a6917-7937-5c9e-9e16-de1ecf6a11ef with identifier: SB84815
2026-03-30 09:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e61a6917-7937-5c9e-9e16-de1ecf6a11ef with scrape type 1
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e61a6917-7937-5c9e-9e16-de1ecf6a11ef
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F65%252Fcf654e542cb934b9ea57a93e653e116f%252Fpa%252FSB84815_08f3e663b6fe382ea93fe026997a6ca9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_08f3e663b6fe382ea93fe026997a6ca9.jpg already downloaded
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F65%252Fcf654e542cb934b9ea57a93e653e116f%252Fpa%252FSB84815_7d31de32b713e866df6ca379812d7949.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_7d31de32b713e866df6ca379812d7949.jpg already downloaded
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F65%252Fcf654e542cb934b9ea57a93e653e116f%252Fpa%252FSB84815_d8b860205f7d81c763b05718faeff09d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_d8b860205f7d81c763b05718faeff09d.jpg already downloaded
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F65%252Fcf654e542cb934b9ea57a93e653e116f%252Fpa%252FSB84815_dbba72bc0b2c01993185d098a64de3a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_dbba72bc0b2c01993185d098a64de3a2.jpg already downloaded
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F65%252Fcf654e542cb934b9ea57a93e653e116f%252Fpa%252FSB84815_01c69ae0251647414847ab9a6e5d11e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_01c69ae0251647414847ab9a6e5d11e2.jpg already downloaded
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F65%252Fcf654e542cb934b9ea57a93e653e116f%252Fpa%252FSB84815_33d7855409a7e67efc14edb19cc58eef.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_33d7855409a7e67efc14edb19cc58eef.jpg already downloaded
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F65%252Fcf654e542cb934b9ea57a93e653e116f%252Fpa%252FSB84815_abba8cac38c252e22b790394872326b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_abba8cac38c252e22b790394872326b1.jpg already downloaded
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F65%252Fcf654e542cb934b9ea57a93e653e116f%252Fpa%252FSB84815_782d3ba94a82e632af6c087a12b1045e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_782d3ba94a82e632af6c087a12b1045e.jpg already downloaded
2026-03-30 09:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F65%252Fcf654e542cb934b9ea57a93e653e116f%252Fpa%252FSB84815_ea431e5506d951143f60e40063cbf393.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_ea431e5506d951143f60e40063cbf393.jpg already downloaded
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F65%252Fcf654e542cb934b9ea57a93e653e116f%252Fpa%252FSB84815_5183a5906aef969d3dec8da2988756b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_5183a5906aef969d3dec8da2988756b2.jpg already downloaded
2026-03-30 09:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e61a6917-7937-5c9e-9e16-de1ecf6a11ef, identifier: SB84815
2026-03-30 09:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f47752c3-4d30-5ecd-baca-78a158010ea5 with identifier: LE83570
2026-03-30 09:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f47752c3-4d30-5ecd-baca-78a158010ea5 with scrape type 1
2026-03-30 09:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f47752c3-4d30-5ecd-baca-78a158010ea5
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_706316b9347ee99a56d5568214f68a0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_706316b9347ee99a56d5568214f68a0b.jpg not downloaded yet
2026-03-30 09:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fc5110>
2026-03-30 09:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_b92126f388f813057d9ffae15d97905d.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_b92126f388f813057d9ffae15d97905d.jpg saved to cache
2026-03-30 09:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f285b5e-287c-5b36-81f7-13f383e6dcde
2026-03-30 09:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e61a6917-7937-5c9e-9e16-de1ecf6a11ef with identifier: SB84815
2026-03-30 09:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e61a6917-7937-5c9e-9e16-de1ecf6a11ef with identifier: SB84815
2026-03-30 09:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e61a6917-7937-5c9e-9e16-de1ecf6a11ef with identifier: SB84815 to the API
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SB84815>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:30:06Z',
 'fuel_type': 'diesel',
 'id': 'e61a6917-7937-5c9e-9e16-de1ecf6a11ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB84815',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'BMW',
 'model': '1er',
 'odometer': 376909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_08f3e663b6fe382ea93fe026997a6ca9.jpg',
                'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_7d31de32b713e866df6ca379812d7949.jpg',
                'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_d8b860205f7d81c763b05718faeff09d.jpg',
                'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_dbba72bc0b2c01993185d098a64de3a2.jpg',
                'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_01c69ae0251647414847ab9a6e5d11e2.jpg',
                'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_33d7855409a7e67efc14edb19cc58eef.jpg',
                'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_abba8cac38c252e22b790394872326b1.jpg',
                'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_782d3ba94a82e632af6c087a12b1045e.jpg',
                'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_ea431e5506d951143f60e40063cbf393.jpg',
                'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_5183a5906aef969d3dec8da2988756b2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61a6917-7937-5c9e-9e16-de1ecf6a11ef/e61a6917-7937-5c9e-9e16-de1ecf6a11ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289609,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_08f3e663b6fe382ea93fe026997a6ca9.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61a6917-7937-5c9e-9e16-de1ecf6a11ef/e61a6917-7937-5c9e-9e16-de1ecf6a11ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_7d31de32b713e866df6ca379812d7949.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61a6917-7937-5c9e-9e16-de1ecf6a11ef/e61a6917-7937-5c9e-9e16-de1ecf6a11ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_d8b860205f7d81c763b05718faeff09d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61a6917-7937-5c9e-9e16-de1ecf6a11ef/e61a6917-7937-5c9e-9e16-de1ecf6a11ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_dbba72bc0b2c01993185d098a64de3a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61a6917-7937-5c9e-9e16-de1ecf6a11ef/e61a6917-7937-5c9e-9e16-de1ecf6a11ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249779,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_01c69ae0251647414847ab9a6e5d11e2.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61a6917-7937-5c9e-9e16-de1ecf6a11ef/e61a6917-7937-5c9e-9e16-de1ecf6a11ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_33d7855409a7e67efc14edb19cc58eef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61a6917-7937-5c9e-9e16-de1ecf6a11ef/e61a6917-7937-5c9e-9e16-de1ecf6a11ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_abba8cac38c252e22b790394872326b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61a6917-7937-5c9e-9e16-de1ecf6a11ef/e61a6917-7937-5c9e-9e16-de1ecf6a11ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_782d3ba94a82e632af6c087a12b1045e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61a6917-7937-5c9e-9e16-de1ecf6a11ef/e61a6917-7937-5c9e-9e16-de1ecf6a11ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_ea431e5506d951143f60e40063cbf393.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61a6917-7937-5c9e-9e16-de1ecf6a11ef/e61a6917-7937-5c9e-9e16-de1ecf6a11ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271068,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/65/cf654e542cb934b9ea57a93e653e116f/pa/SB84815_5183a5906aef969d3dec8da2988756b2.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 120d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB84815%27 HTTP/1.1" 200 None
2026-03-30 09:04:53 [auto1.it] INFO: Saving data for SB84815: {'created_time': 1774861493.634139, 'last_price_update_time': 1774861493.634152, 'auction_closing_time': 1774971006.0}
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SB84815') HTTP/1.1" 204 0
2026-03-30 09:04:53 [auto1.it] INFO: Found listing with ID: TT29802
2026-03-30 09:04:53 [auto1.it] INFO: Found listing with ID: WG32639
2026-03-30 09:04:53 [auto1.it] INFO: Found listing with ID: DT03603
2026-03-30 09:04:53 [auto1.it] INFO: Found listing with ID: BW92200
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW92200%27 HTTP/1.1" 200 None
2026-03-30 09:04:53 [auto1.it] INFO: Scrape type for BW92200: 2
2026-03-30 09:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6327f8d-7fe0-5b60-971d-f5fd70b90d28 with identifier: BW92200
2026-03-30 09:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6327f8d-7fe0-5b60-971d-f5fd70b90d28 with scrape type 2
2026-03-30 09:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6327f8d-7fe0-5b60-971d-f5fd70b90d28 with scrape type 2
2026-03-30 09:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f6327f8d-7fe0-5b60-971d-f5fd70b90d28, identifier: BW92200
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_764542bf971bf13d0b2bd184cacfb68b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_764542bf971bf13d0b2bd184cacfb68b.jpg not downloaded yet
2026-03-30 09:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f6327f8d-7fe0-5b60-971d-f5fd70b90d28 with identifier: BW92200
2026-03-30 09:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f6327f8d-7fe0-5b60-971d-f5fd70b90d28 with identifier: BW92200
2026-03-30 09:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f6327f8d-7fe0-5b60-971d-f5fd70b90d28 with identifier: BW92200 to the API
2026-03-30 09:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:07:43Z',
 'fuel_type': 'diesel',
 'id': 'f6327f8d-7fe0-5b60-971d-f5fd70b90d28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW92200',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 122197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 35 L3',
 'transmission': 'manual',
 'trim': '35 L3',
 'year': 2023}
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW92200%27 HTTP/1.1" 200 None
2026-03-30 09:04:54 [auto1.it] INFO: Saving data for BW92200: {'auction_closing_time': 1774969663.0, 'created_time': 1774429290.839711, 'last_price_update_time': 1774861494.122286}
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BW92200') HTTP/1.1" 204 0
2026-03-30 09:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ15098> (referer: https://www.auto1.com/v1/car-details-view/VJ15098/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL27846> (referer: https://www.auto1.com/v1/car-details-view/RL27846/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:54 [auto1.it] INFO: Found listing with ID: JJ00308
2026-03-30 09:04:54 [auto1.it] INFO: Found listing with ID: SM78375
2026-03-30 09:04:54 [auto1.it] INFO: Found listing with ID: XV63353
2026-03-30 09:04:54 [auto1.it] INFO: Found listing with ID: AF62726
2026-03-30 09:04:54 [auto1.it] INFO: Found listing with ID: JK19998
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK19998%27 HTTP/1.1" 200 None
2026-03-30 09:04:54 [auto1.it] INFO: Scrape type for JK19998: 2
2026-03-30 09:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8191c22-5705-5e83-8ebf-d337187aeadf with identifier: JK19998
2026-03-30 09:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8191c22-5705-5e83-8ebf-d337187aeadf with scrape type 2
2026-03-30 09:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8191c22-5705-5e83-8ebf-d337187aeadf with scrape type 2
2026-03-30 09:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e8191c22-5705-5e83-8ebf-d337187aeadf, identifier: JK19998
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_0d2f370f1c41ab98552333dcdd0c06b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_0d2f370f1c41ab98552333dcdd0c06b9.jpg not downloaded yet
2026-03-30 09:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM97698> (referer: https://www.auto1.com/v1/car-details-view/NM97698/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_ddd6f1357ba294b2bd231f5ca3e175b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_e85b095002c5312ce11d2922af750651.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e8191c22-5705-5e83-8ebf-d337187aeadf with identifier: JK19998
2026-03-30 09:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e8191c22-5705-5e83-8ebf-d337187aeadf with identifier: JK19998
2026-03-30 09:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e8191c22-5705-5e83-8ebf-d337187aeadf with identifier: JK19998 to the API
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:28:40Z',
 'fuel_type': 'diesel',
 'id': 'e8191c22-5705-5e83-8ebf-d337187aeadf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK19998',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 131579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-31',
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Cool 2WD',
 'transmission': 'manual',
 'trim': 'Cool 2WD',
 'year': 2013}
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK19998%27 HTTP/1.1" 200 None
2026-03-30 09:04:54 [auto1.it] INFO: Saving data for JK19998: {'auction_closing_time': 1774970920.0, 'created_time': 1774126997.495159, 'last_price_update_time': 1774861494.680376}
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JK19998') HTTP/1.1" 204 0
2026-03-30 09:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:54 [auto1.it] INFO: Found listing with ID: AA77653
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA77653%27 HTTP/1.1" 200 None
2026-03-30 09:04:54 [auto1.it] INFO: Scrape type for AA77653: 2
2026-03-30 09:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 965cd6fc-5268-5439-af0f-05a50e3726fd with identifier: AA77653
2026-03-30 09:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 965cd6fc-5268-5439-af0f-05a50e3726fd with scrape type 2
2026-03-30 09:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 965cd6fc-5268-5439-af0f-05a50e3726fd with scrape type 2
2026-03-30 09:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 965cd6fc-5268-5439-af0f-05a50e3726fd, identifier: AA77653
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_318b6e2505735e8d9062a330a8229f95.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_318b6e2505735e8d9062a330a8229f95.jpg not downloaded yet
2026-03-30 09:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 965cd6fc-5268-5439-af0f-05a50e3726fd with identifier: AA77653
2026-03-30 09:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 965cd6fc-5268-5439-af0f-05a50e3726fd with identifier: AA77653
2026-03-30 09:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 965cd6fc-5268-5439-af0f-05a50e3726fd with identifier: AA77653 to the API
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:11:36Z',
 'fuel_type': 'hybrid',
 'id': '965cd6fc-5268-5439-af0f-05a50e3726fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA77653',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 87876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-26',
 'seller_name': None,
 'title': 'Opel Grandland X 1.6 Plug-in Hybrid 4 GSe',
 'transmission': 'automatic',
 'trim': 'GSe',
 'year': 2023}
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA77653%27 HTTP/1.1" 200 None
2026-03-30 09:04:55 [auto1.it] INFO: Saving data for AA77653: {'auction_closing_time': 1774969896.0, 'created_time': 1772705265.668185, 'last_price_update_time': 1774861495.652365}
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AA77653') HTTP/1.1" 204 0
2026-03-30 09:04:55 [auto1.it] INFO: Found listing with ID: PC98849
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC98849%27 HTTP/1.1" 200 None
2026-03-30 09:04:55 [auto1.it] INFO: Scrape type for PC98849: 2
2026-03-30 09:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5868cc7-4556-59cd-a6d5-faf67dd73e1f with identifier: PC98849
2026-03-30 09:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5868cc7-4556-59cd-a6d5-faf67dd73e1f with scrape type 2
2026-03-30 09:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5868cc7-4556-59cd-a6d5-faf67dd73e1f with scrape type 2
2026-03-30 09:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d5868cc7-4556-59cd-a6d5-faf67dd73e1f, identifier: PC98849
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_11f4d10039ab9a5672d1f1365f966ea7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_11f4d10039ab9a5672d1f1365f966ea7.jpg not downloaded yet
2026-03-30 09:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP75996> (referer: https://www.auto1.com/v1/car-details-view/BP75996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48a628bf-789b-5a07-8159-75955d3df133 with identifier: VJ15098
2026-03-30 09:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48a628bf-789b-5a07-8159-75955d3df133 with scrape type 1
2026-03-30 09:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 48a628bf-789b-5a07-8159-75955d3df133
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bb4674fb6c586ef53075bb50eea026%252Fpa%252FVJ15098_3f088e1a2d0ee798ff89618cfe7c6ce8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_3f088e1a2d0ee798ff89618cfe7c6ce8.jpg already downloaded
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bb4674fb6c586ef53075bb50eea026%252Fpa%252FVJ15098_1ce946714a0ad6c50287199f1bc0e0c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_1ce946714a0ad6c50287199f1bc0e0c7.jpg already downloaded
2026-03-30 09:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bb4674fb6c586ef53075bb50eea026%252Fpa%252FVJ15098_060db1377bbc86247a59c8330a8f87b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_060db1377bbc86247a59c8330a8f87b9.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bb4674fb6c586ef53075bb50eea026%252Fpa%252FVJ15098_88774aece2d8cfb893081d8f0c64256e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_88774aece2d8cfb893081d8f0c64256e.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bb4674fb6c586ef53075bb50eea026%252Fpa%252FVJ15098_135d3f541ee44cd3c15023e41c2b5dad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_135d3f541ee44cd3c15023e41c2b5dad.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bb4674fb6c586ef53075bb50eea026%252Fpa%252FVJ15098_7c1bf69fc7125c34cf22331ddf797fae.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_7c1bf69fc7125c34cf22331ddf797fae.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bb4674fb6c586ef53075bb50eea026%252Fpa%252FVJ15098_d063737e6ef5a4d9c9251cd878c92f0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_d063737e6ef5a4d9c9251cd878c92f0c.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bb4674fb6c586ef53075bb50eea026%252Fpa%252FVJ15098_a64c0972eae9f0ae257403b88ffddfc6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_a64c0972eae9f0ae257403b88ffddfc6.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bb4674fb6c586ef53075bb50eea026%252Fpa%252FVJ15098_e75045abbf527d425a81e56987022ac2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_e75045abbf527d425a81e56987022ac2.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fbb%252Ff6bb4674fb6c586ef53075bb50eea026%252Fpa%252FVJ15098_321307256733286dc8ce1db0e0170061.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_321307256733286dc8ce1db0e0170061.jpg already downloaded
2026-03-30 09:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 48a628bf-789b-5a07-8159-75955d3df133, identifier: VJ15098
2026-03-30 09:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a10753b0-849a-5bdc-855e-2c1c9150870e with identifier: RL27846
2026-03-30 09:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a10753b0-849a-5bdc-855e-2c1c9150870e with scrape type 1
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a10753b0-849a-5bdc-855e-2c1c9150870e
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F00%252F50002cf4591985e2f7ada2bb0eeeb49f%252Fpa%252FRL27846_3fe4621d12486ead483b21070597fa6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_3fe4621d12486ead483b21070597fa6d.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F00%252F50002cf4591985e2f7ada2bb0eeeb49f%252Fpa%252FRL27846_681cf8cbcf46c3d7049d01365e0861ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_681cf8cbcf46c3d7049d01365e0861ef.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F00%252F50002cf4591985e2f7ada2bb0eeeb49f%252Fpa%252FRL27846_f91486f2e5cbce8b31c31469d3e242ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_f91486f2e5cbce8b31c31469d3e242ce.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F00%252F50002cf4591985e2f7ada2bb0eeeb49f%252Fpa%252FRL27846_07034664cdf5f3d78d58460cdd69cbe7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_07034664cdf5f3d78d58460cdd69cbe7.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F00%252F50002cf4591985e2f7ada2bb0eeeb49f%252Fpa%252FRL27846_d0da9b2ea0810378dc850e7652337a19.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_d0da9b2ea0810378dc850e7652337a19.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F00%252F50002cf4591985e2f7ada2bb0eeeb49f%252Fpa%252FRL27846_17b3f4a9830fcc96500e84ec9ec39e33.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_17b3f4a9830fcc96500e84ec9ec39e33.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F00%252F50002cf4591985e2f7ada2bb0eeeb49f%252Fpa%252FRL27846_5f1048f5259b9e85045c20d536651836.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_5f1048f5259b9e85045c20d536651836.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F00%252F50002cf4591985e2f7ada2bb0eeeb49f%252Fpa%252FRL27846_a1c88c8f773adfaa0c28efa3a6898d1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_a1c88c8f773adfaa0c28efa3a6898d1b.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F00%252F50002cf4591985e2f7ada2bb0eeeb49f%252Fpa%252FRL27846_bdca3b842d215026b559caded72b1846.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_bdca3b842d215026b559caded72b1846.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F00%252F50002cf4591985e2f7ada2bb0eeeb49f%252Fpa%252FRL27846_684279658838d4302de3cb571cc1ed24.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_684279658838d4302de3cb571cc1ed24.jpg already downloaded
2026-03-30 09:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a10753b0-849a-5bdc-855e-2c1c9150870e, identifier: RL27846
2026-03-30 09:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4605b25-e638-54bf-a330-9b58b87e8043 with identifier: NM97698
2026-03-30 09:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4605b25-e638-54bf-a330-9b58b87e8043 with scrape type 1
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4605b25-e638-54bf-a330-9b58b87e8043
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F90%252F4f90f8a680177703ef33c40eabad594d%252Fpa%252FNM97698_42e67f04d371aa3fa19f3b4074470a94.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_42e67f04d371aa3fa19f3b4074470a94.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F90%252F4f90f8a680177703ef33c40eabad594d%252Fpa%252FNM97698_fabc223bf3b124cd1638c59f26e7decc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_fabc223bf3b124cd1638c59f26e7decc.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F90%252F4f90f8a680177703ef33c40eabad594d%252Fpa%252FNM97698_642f79d4b7695015bf246a7aa633687f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_642f79d4b7695015bf246a7aa633687f.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F90%252F4f90f8a680177703ef33c40eabad594d%252Fpa%252FNM97698_65f47137ca75504bd2066bf619ae49f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_65f47137ca75504bd2066bf619ae49f5.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F90%252F4f90f8a680177703ef33c40eabad594d%252Fpa%252FNM97698_b3c46b64c91361b4bbe9b0af68ed8027.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_b3c46b64c91361b4bbe9b0af68ed8027.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F90%252F4f90f8a680177703ef33c40eabad594d%252Fpa%252FNM97698_1446c9e5d41b0568e3a16e6461ef10e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_1446c9e5d41b0568e3a16e6461ef10e8.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F90%252F4f90f8a680177703ef33c40eabad594d%252Fpa%252FNM97698_ab29241e680187f4482948bbd4bfb285.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_ab29241e680187f4482948bbd4bfb285.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F90%252F4f90f8a680177703ef33c40eabad594d%252Fpa%252FNM97698_a4e4401eaac2f9055fd6233768aedfc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_a4e4401eaac2f9055fd6233768aedfc2.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F90%252F4f90f8a680177703ef33c40eabad594d%252Fpa%252FNM97698_0b941b1d7e9203d47a158436325d2cbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_0b941b1d7e9203d47a158436325d2cbd.jpg already downloaded
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F90%252F4f90f8a680177703ef33c40eabad594d%252Fpa%252FNM97698_198f29a302746d35d5353bb1558b2d15.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_198f29a302746d35d5353bb1558b2d15.jpg already downloaded
2026-03-30 09:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e4605b25-e638-54bf-a330-9b58b87e8043, identifier: NM97698
2026-03-30 09:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061ddc10>
2026-03-30 09:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F4a%252F984a3fafc25ab3ad99953e8df5d6c760%252Fpa%252FBD18129_ddd6f1357ba294b2bd231f5ca3e175b7.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_ddd6f1357ba294b2bd231f5ca3e175b7.jpg saved to cache
2026-03-30 09:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-03-30 09:04:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7005b13-c60f-5c0b-8bb1-128a46e03f89, skipping ID generation
2026-03-30 09:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7005b13-c60f-5c0b-8bb1-128a46e03f89 with scrape type 1
2026-03-30 09:04:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7005b13-c60f-5c0b-8bb1-128a46e03f89 sending to next pipeline
2026-03-30 09:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7005b13-c60f-5c0b-8bb1-128a46e03f89, identifier: BD18129
2026-03-30 09:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e78350>
2026-03-30 09:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_e85b095002c5312ce11d2922af750651.jpg') HTTP/1.1" 204 0
2026-03-30 09:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_e85b095002c5312ce11d2922af750651.jpg saved to cache
2026-03-30 09:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3894e5d6-f6df-53e3-89d9-a84134c634d2
2026-03-30 09:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_764542bf971bf13d0b2bd184cacfb68b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d5868cc7-4556-59cd-a6d5-faf67dd73e1f with identifier: PC98849
2026-03-30 09:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d5868cc7-4556-59cd-a6d5-faf67dd73e1f with identifier: PC98849
2026-03-30 09:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d5868cc7-4556-59cd-a6d5-faf67dd73e1f with identifier: PC98849 to the API
2026-03-30 09:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:55:29Z',
 'fuel_type': 'diesel',
 'id': 'd5868cc7-4556-59cd-a6d5-faf67dd73e1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC98849',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 116518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'Fiat 500L 1.6 JTDM Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2015}
2026-03-30 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC98849%27 HTTP/1.1" 200 None
2026-03-30 09:04:58 [auto1.it] INFO: Saving data for PC98849: {'auction_closing_time': 1774972529.0, 'created_time': 1772222470.066962, 'last_price_update_time': 1774861498.257173}
2026-03-30 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PC98849') HTTP/1.1" 204 0
2026-03-30 09:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA22711> (referer: https://www.auto1.com/v1/car-details-view/GA22711/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY67923> (referer: https://www.auto1.com/v1/car-details-view/DY67923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 48a628bf-789b-5a07-8159-75955d3df133 with identifier: VJ15098
2026-03-30 09:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 48a628bf-789b-5a07-8159-75955d3df133 with identifier: VJ15098
2026-03-30 09:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 48a628bf-789b-5a07-8159-75955d3df133 with identifier: VJ15098 to the API
2026-03-30 09:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VJ15098>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:48:19Z',
 'fuel_type': 'petrol',
 'id': '48a628bf-789b-5a07-8159-75955d3df133',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ15098',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 26258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_3f088e1a2d0ee798ff89618cfe7c6ce8.jpg',
                'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_1ce946714a0ad6c50287199f1bc0e0c7.jpg',
                'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_060db1377bbc86247a59c8330a8f87b9.jpg',
                'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_88774aece2d8cfb893081d8f0c64256e.jpg',
                'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_135d3f541ee44cd3c15023e41c2b5dad.jpg',
                'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_7c1bf69fc7125c34cf22331ddf797fae.jpg',
                'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_d063737e6ef5a4d9c9251cd878c92f0c.jpg',
                'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_a64c0972eae9f0ae257403b88ffddfc6.jpg',
                'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_e75045abbf527d425a81e56987022ac2.jpg',
                'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_321307256733286dc8ce1db0e0170061.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a628bf-789b-5a07-8159-75955d3df133/48a628bf-789b-5a07-8159-75955d3df133_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_3f088e1a2d0ee798ff89618cfe7c6ce8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a628bf-789b-5a07-8159-75955d3df133/48a628bf-789b-5a07-8159-75955d3df133_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_1ce946714a0ad6c50287199f1bc0e0c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a628bf-789b-5a07-8159-75955d3df133/48a628bf-789b-5a07-8159-75955d3df133_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_060db1377bbc86247a59c8330a8f87b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a628bf-789b-5a07-8159-75955d3df133/48a628bf-789b-5a07-8159-75955d3df133_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_88774aece2d8cfb893081d8f0c64256e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a628bf-789b-5a07-8159-75955d3df133/48a628bf-789b-5a07-8159-75955d3df133_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_135d3f541ee44cd3c15023e41c2b5dad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a628bf-789b-5a07-8159-75955d3df133/48a628bf-789b-5a07-8159-75955d3df133_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_7c1bf69fc7125c34cf22331ddf797fae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a628bf-789b-5a07-8159-75955d3df133/48a628bf-789b-5a07-8159-75955d3df133_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_d063737e6ef5a4d9c9251cd878c92f0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a628bf-789b-5a07-8159-75955d3df133/48a628bf-789b-5a07-8159-75955d3df133_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_a64c0972eae9f0ae257403b88ffddfc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a628bf-789b-5a07-8159-75955d3df133/48a628bf-789b-5a07-8159-75955d3df133_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_e75045abbf527d425a81e56987022ac2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a628bf-789b-5a07-8159-75955d3df133/48a628bf-789b-5a07-8159-75955d3df133_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/bb/f6bb4674fb6c586ef53075bb50eea026/pa/VJ15098_321307256733286dc8ce1db0e0170061.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2022}
2026-03-30 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ15098%27 HTTP/1.1" 200 None
2026-03-30 09:04:58 [auto1.it] INFO: Saving data for VJ15098: {'created_time': 1774861498.617426, 'last_price_update_time': 1774861498.617437, 'auction_closing_time': 1774972099.0}
2026-03-30 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VJ15098') HTTP/1.1" 204 0
2026-03-30 09:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a10753b0-849a-5bdc-855e-2c1c9150870e with identifier: RL27846
2026-03-30 09:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a10753b0-849a-5bdc-855e-2c1c9150870e with identifier: RL27846
2026-03-30 09:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a10753b0-849a-5bdc-855e-2c1c9150870e with identifier: RL27846 to the API
2026-03-30 09:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RL27846>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:37:15Z',
 'fuel_type': 'diesel',
 'id': 'a10753b0-849a-5bdc-855e-2c1c9150870e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL27846',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 223394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_3fe4621d12486ead483b21070597fa6d.jpg',
                'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_681cf8cbcf46c3d7049d01365e0861ef.jpg',
                'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_f91486f2e5cbce8b31c31469d3e242ce.jpg',
                'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_07034664cdf5f3d78d58460cdd69cbe7.jpg',
                'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_d0da9b2ea0810378dc850e7652337a19.jpg',
                'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_17b3f4a9830fcc96500e84ec9ec39e33.jpg',
                'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_5f1048f5259b9e85045c20d536651836.jpg',
                'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_a1c88c8f773adfaa0c28efa3a6898d1b.jpg',
                'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_bdca3b842d215026b559caded72b1846.jpg',
                'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_684279658838d4302de3cb571cc1ed24.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a10753b0-849a-5bdc-855e-2c1c9150870e/a10753b0-849a-5bdc-855e-2c1c9150870e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_3fe4621d12486ead483b21070597fa6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a10753b0-849a-5bdc-855e-2c1c9150870e/a10753b0-849a-5bdc-855e-2c1c9150870e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_681cf8cbcf46c3d7049d01365e0861ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a10753b0-849a-5bdc-855e-2c1c9150870e/a10753b0-849a-5bdc-855e-2c1c9150870e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_f91486f2e5cbce8b31c31469d3e242ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a10753b0-849a-5bdc-855e-2c1c9150870e/a10753b0-849a-5bdc-855e-2c1c9150870e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_07034664cdf5f3d78d58460cdd69cbe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a10753b0-849a-5bdc-855e-2c1c9150870e/a10753b0-849a-5bdc-855e-2c1c9150870e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_d0da9b2ea0810378dc850e7652337a19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a10753b0-849a-5bdc-855e-2c1c9150870e/a10753b0-849a-5bdc-855e-2c1c9150870e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_17b3f4a9830fcc96500e84ec9ec39e33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a10753b0-849a-5bdc-855e-2c1c9150870e/a10753b0-849a-5bdc-855e-2c1c9150870e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_5f1048f5259b9e85045c20d536651836.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a10753b0-849a-5bdc-855e-2c1c9150870e/a10753b0-849a-5bdc-855e-2c1c9150870e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_a1c88c8f773adfaa0c28efa3a6898d1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a10753b0-849a-5bdc-855e-2c1c9150870e/a10753b0-849a-5bdc-855e-2c1c9150870e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_bdca3b842d215026b559caded72b1846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a10753b0-849a-5bdc-855e-2c1c9150870e/a10753b0-849a-5bdc-855e-2c1c9150870e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/00/50002cf4591985e2f7ada2bb0eeeb49f/pa/RL27846_684279658838d4302de3cb571cc1ed24.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
 'transmission': 'automatic',
 'trim': 'Kinetic 2WD',
 'year': 2015}
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL27846%27 HTTP/1.1" 200 None
2026-03-30 09:04:59 [auto1.it] INFO: Saving data for RL27846: {'created_time': 1774861499.014109, 'last_price_update_time': 1774861499.014119, 'auction_closing_time': 1774971435.0}
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RL27846') HTTP/1.1" 204 0
2026-03-30 09:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e4605b25-e638-54bf-a330-9b58b87e8043 with identifier: NM97698
2026-03-30 09:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e4605b25-e638-54bf-a330-9b58b87e8043 with identifier: NM97698
2026-03-30 09:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e4605b25-e638-54bf-a330-9b58b87e8043 with identifier: NM97698 to the API
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NM97698>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:52:44Z',
 'fuel_type': 'diesel',
 'id': 'e4605b25-e638-54bf-a330-9b58b87e8043',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM97698',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 146738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_42e67f04d371aa3fa19f3b4074470a94.jpg',
                'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_fabc223bf3b124cd1638c59f26e7decc.jpg',
                'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_642f79d4b7695015bf246a7aa633687f.jpg',
                'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_65f47137ca75504bd2066bf619ae49f5.jpg',
                'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_b3c46b64c91361b4bbe9b0af68ed8027.jpg',
                'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_1446c9e5d41b0568e3a16e6461ef10e8.jpg',
                'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_ab29241e680187f4482948bbd4bfb285.jpg',
                'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_a4e4401eaac2f9055fd6233768aedfc2.jpg',
                'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_0b941b1d7e9203d47a158436325d2cbd.jpg',
                'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_198f29a302746d35d5353bb1558b2d15.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385111,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_42e67f04d371aa3fa19f3b4074470a94.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362057,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_fabc223bf3b124cd1638c59f26e7decc.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394368,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_642f79d4b7695015bf246a7aa633687f.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_65f47137ca75504bd2066bf619ae49f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473358,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_b3c46b64c91361b4bbe9b0af68ed8027.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_1446c9e5d41b0568e3a16e6461ef10e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_ab29241e680187f4482948bbd4bfb285.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384190,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_a4e4401eaac2f9055fd6233768aedfc2.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382661,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_0b941b1d7e9203d47a158436325d2cbd.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_198f29a302746d35d5353bb1558b2d15.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM97698%27 HTTP/1.1" 200 None
2026-03-30 09:04:59 [auto1.it] INFO: Saving data for NM97698: {'created_time': 1774861499.347137, 'last_price_update_time': 1774861499.347151, 'auction_closing_time': 1774972364.0}
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NM97698') HTTP/1.1" 204 0
2026-03-30 09:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7005b13-c60f-5c0b-8bb1-128a46e03f89 with identifier: BD18129
2026-03-30 09:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7005b13-c60f-5c0b-8bb1-128a46e03f89 with identifier: BD18129
2026-03-30 09:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f7005b13-c60f-5c0b-8bb1-128a46e03f89 with identifier: BD18129 to the API
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_ddd6f1357ba294b2bd231f5ca3e175b7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:01:13Z',
 'fuel_type': 'diesel',
 'id': 'f7005b13-c60f-5c0b-8bb1-128a46e03f89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD18129',
 'listing': 'auction',
 'location': 'IT, Napoli',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 173795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_ddd6f1357ba294b2bd231f5ca3e175b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_545e13fadfe577529da51540fad9ca38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_4916ab39fc725a87a7d0b3b22d13eca8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_addd01110743fbe9636f49725018b908.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_5ad90f17a61fdcb8af4a03d6855a3022.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_c8c82dfe1c45e7f72dcbfbf8e765a3ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_391704cdb0129d09303c080657847844.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_260f9e62f1a0f55c992112e402f2a307.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_8562bb8cbe36bffbd6bd568d9ec6803b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_08cb586b8b0486f1c8874952308498eb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2008}
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD18129%27 HTTP/1.1" 200 None
2026-03-30 09:04:59 [auto1.it] INFO: Saving data for BD18129: {'created_time': 1774861499.725732, 'last_price_update_time': 1774861499.725743, 'auction_closing_time': 1774969273.0}
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BD18129') HTTP/1.1" 204 0
2026-03-30 09:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_706316b9347ee99a56d5568214f68a0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:04:59 [auto1.it] INFO: Found listing with ID: ZH14156
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH14156%27 HTTP/1.1" 200 None
2026-03-30 09:04:59 [auto1.it] INFO: Scrape type for ZH14156: 1
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_015365954e7ce03974a9cbac270fc949.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_015365954e7ce03974a9cbac270fc949.jpg not downloaded yet
2026-03-30 09:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF83888> (referer: https://www.auto1.com/v1/car-details-view/YF83888/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:04:59 [auto1.it] INFO: Found listing with ID: MW39681
2026-03-30 09:04:59 [auto1.it] INFO: Found listing with ID: ED24082
2026-03-30 09:04:59 [auto1.it] INFO: Found listing with ID: CS63696
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS63696%27 HTTP/1.1" 200 None
2026-03-30 09:04:59 [auto1.it] INFO: Scrape type for CS63696: 2
2026-03-30 09:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be69283e-4b25-5a0c-a417-b22f3a2239fc with identifier: CS63696
2026-03-30 09:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be69283e-4b25-5a0c-a417-b22f3a2239fc with scrape type 2
2026-03-30 09:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be69283e-4b25-5a0c-a417-b22f3a2239fc with scrape type 2
2026-03-30 09:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be69283e-4b25-5a0c-a417-b22f3a2239fc, identifier: CS63696
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_212be9cba6ee787ce8ec964bff65489d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_212be9cba6ee787ce8ec964bff65489d.jpg not downloaded yet
2026-03-30 09:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be69283e-4b25-5a0c-a417-b22f3a2239fc with identifier: CS63696
2026-03-30 09:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be69283e-4b25-5a0c-a417-b22f3a2239fc with identifier: CS63696
2026-03-30 09:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be69283e-4b25-5a0c-a417-b22f3a2239fc with identifier: CS63696 to the API
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:01:40Z',
 'fuel_type': 'petrol',
 'id': 'be69283e-4b25-5a0c-a417-b22f3a2239fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS63696',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 57988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-30',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS63696%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [auto1.it] INFO: Saving data for CS63696: {'auction_closing_time': 1774969300.0, 'created_time': 1774342958.878183, 'last_price_update_time': 1774861500.322492}
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CS63696') HTTP/1.1" 204 0
2026-03-30 09:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55ac0198-0d9c-55ac-86c9-8fc9b9031cfb with identifier: BP75996
2026-03-30 09:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55ac0198-0d9c-55ac-86c9-8fc9b9031cfb with scrape type 1
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 55ac0198-0d9c-55ac-86c9-8fc9b9031cfb
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc2%252Fe5c2101d929b5c2095857f6f3930c6ed%252Fpa%252FBP75996_f63351ae8b675c80226e6ffee4d6b89d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_f63351ae8b675c80226e6ffee4d6b89d.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc2%252Fe5c2101d929b5c2095857f6f3930c6ed%252Fpa%252FBP75996_9b54b72672047ed22e5561cfcbe3b5a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_9b54b72672047ed22e5561cfcbe3b5a3.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc2%252Fe5c2101d929b5c2095857f6f3930c6ed%252Fpa%252FBP75996_5447c60942723b57996555ce2e12233e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_5447c60942723b57996555ce2e12233e.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc2%252Fe5c2101d929b5c2095857f6f3930c6ed%252Fpa%252FBP75996_e1d7d8a5e25f3e5b5e5726e585d9ac00.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_e1d7d8a5e25f3e5b5e5726e585d9ac00.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc2%252Fe5c2101d929b5c2095857f6f3930c6ed%252Fpa%252FBP75996_48f287eb3bb1630cb892dd7be4e0cb99.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_48f287eb3bb1630cb892dd7be4e0cb99.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fc2%252Fe5c2101d929b5c2095857f6f3930c6ed%252Fpa%252FBP75996_0c4becf4ef7926177e8c8a0d786b9d1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_0c4becf4ef7926177e8c8a0d786b9d1a.jpg already downloaded
2026-03-30 09:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 55ac0198-0d9c-55ac-86c9-8fc9b9031cfb, identifier: BP75996
2026-03-30 09:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06caa750>
2026-03-30 09:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_764542bf971bf13d0b2bd184cacfb68b.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_764542bf971bf13d0b2bd184cacfb68b.jpg saved to cache
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f47752c3-4d30-5ecd-baca-78a158010ea5
2026-03-30 09:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23c2758-3cf7-594f-a099-9521d3244bb4 with identifier: GA22711
2026-03-30 09:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23c2758-3cf7-594f-a099-9521d3244bb4 with scrape type 1
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f23c2758-3cf7-594f-a099-9521d3244bb4
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_dd1450349f15c46ae4a7e770a601ff28.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_dd1450349f15c46ae4a7e770a601ff28.jpg not downloaded yet
2026-03-30 09:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c4fef27-ebc2-5f02-b579-f84c2210f482 with identifier: DY67923
2026-03-30 09:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c4fef27-ebc2-5f02-b579-f84c2210f482 with scrape type 1
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c4fef27-ebc2-5f02-b579-f84c2210f482
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F89%252Faa897c743daf3ff7bfac053601544a04%252Fpa%252FDY67923_9fca5262da7b081a13fed3a5b8ef0d22.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_9fca5262da7b081a13fed3a5b8ef0d22.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F89%252Faa897c743daf3ff7bfac053601544a04%252Fpa%252FDY67923_c9d67539572519a1628c4605f9a61e1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_c9d67539572519a1628c4605f9a61e1a.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F89%252Faa897c743daf3ff7bfac053601544a04%252Fpa%252FDY67923_adb482fbd57c1fd032e5f2dd1c80ce81.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_adb482fbd57c1fd032e5f2dd1c80ce81.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F89%252Faa897c743daf3ff7bfac053601544a04%252Fpa%252FDY67923_20130615dc48aaa8638d31538fced437.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_20130615dc48aaa8638d31538fced437.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F89%252Faa897c743daf3ff7bfac053601544a04%252Fpa%252FDY67923_d77bb0079ff7f6d6a61b5187f7509f23.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_d77bb0079ff7f6d6a61b5187f7509f23.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F89%252Faa897c743daf3ff7bfac053601544a04%252Fpa%252FDY67923_5959143a30f888ae8a887d13ae70adaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_5959143a30f888ae8a887d13ae70adaf.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F89%252Faa897c743daf3ff7bfac053601544a04%252Fpa%252FDY67923_e386dbf3ffcdbd9b9505073210a0bd7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_e386dbf3ffcdbd9b9505073210a0bd7a.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F89%252Faa897c743daf3ff7bfac053601544a04%252Fpa%252FDY67923_ce249a303c1899be7d87eed27aa2c4e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_ce249a303c1899be7d87eed27aa2c4e8.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F89%252Faa897c743daf3ff7bfac053601544a04%252Fpa%252FDY67923_e28bac39b258933db7d163bbb511784e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_e28bac39b258933db7d163bbb511784e.jpg already downloaded
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F89%252Faa897c743daf3ff7bfac053601544a04%252Fpa%252FDY67923_d92c3162d603b260558f741c0dcf251c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_d92c3162d603b260558f741c0dcf251c.jpg already downloaded
2026-03-30 09:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c4fef27-ebc2-5f02-b579-f84c2210f482, identifier: DY67923
2026-03-30 09:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_e3df93f65c076b720b5fdd0b87d90b61.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:00 [auto1.it] INFO: Found listing with ID: TK21590
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK21590%27 HTTP/1.1" 200 None
2026-03-30 09:05:00 [auto1.it] INFO: Scrape type for TK21590: 2
2026-03-30 09:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b62895b-7010-5b17-975f-52a9c4b872b9 with identifier: TK21590
2026-03-30 09:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b62895b-7010-5b17-975f-52a9c4b872b9 with scrape type 2
2026-03-30 09:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b62895b-7010-5b17-975f-52a9c4b872b9 with scrape type 2
2026-03-30 09:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5b62895b-7010-5b17-975f-52a9c4b872b9, identifier: TK21590
2026-03-30 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_6984023a8a593be9dec3036e1c245072.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_6984023a8a593be9dec3036e1c245072.jpg not downloaded yet
2026-03-30 09:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 55ac0198-0d9c-55ac-86c9-8fc9b9031cfb with identifier: BP75996
2026-03-30 09:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 55ac0198-0d9c-55ac-86c9-8fc9b9031cfb with identifier: BP75996
2026-03-30 09:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 55ac0198-0d9c-55ac-86c9-8fc9b9031cfb with identifier: BP75996 to the API
2026-03-30 09:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BP75996>
{'auction_title': '',
 'c_o_2_emission_value': 250,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '2.5L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:20:27Z',
 'fuel_type': 'diesel',
 'id': '55ac0198-0d9c-55ac-86c9-8fc9b9031cfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP75996',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 297462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_f63351ae8b675c80226e6ffee4d6b89d.jpg',
                'https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_9b54b72672047ed22e5561cfcbe3b5a3.jpg',
                'https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_5447c60942723b57996555ce2e12233e.jpg',
                'https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_e1d7d8a5e25f3e5b5e5726e585d9ac00.jpg',
                'https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_48f287eb3bb1630cb892dd7be4e0cb99.jpg',
                'https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_0c4becf4ef7926177e8c8a0d786b9d1a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ac0198-0d9c-55ac-86c9-8fc9b9031cfb/55ac0198-0d9c-55ac-86c9-8fc9b9031cfb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_f63351ae8b675c80226e6ffee4d6b89d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ac0198-0d9c-55ac-86c9-8fc9b9031cfb/55ac0198-0d9c-55ac-86c9-8fc9b9031cfb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_9b54b72672047ed22e5561cfcbe3b5a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ac0198-0d9c-55ac-86c9-8fc9b9031cfb/55ac0198-0d9c-55ac-86c9-8fc9b9031cfb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_5447c60942723b57996555ce2e12233e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ac0198-0d9c-55ac-86c9-8fc9b9031cfb/55ac0198-0d9c-55ac-86c9-8fc9b9031cfb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_e1d7d8a5e25f3e5b5e5726e585d9ac00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ac0198-0d9c-55ac-86c9-8fc9b9031cfb/55ac0198-0d9c-55ac-86c9-8fc9b9031cfb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_48f287eb3bb1630cb892dd7be4e0cb99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ac0198-0d9c-55ac-86c9-8fc9b9031cfb/55ac0198-0d9c-55ac-86c9-8fc9b9031cfb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/c2/e5c2101d929b5c2095857f6f3930c6ed/pa/BP75996_0c4becf4ef7926177e8c8a0d786b9d1a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Cherokee 2.5 CRD Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2002}
2026-03-30 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP75996%27 HTTP/1.1" 200 None
2026-03-30 09:05:01 [auto1.it] INFO: Saving data for BP75996: {'created_time': 1774861501.673097, 'last_price_update_time': 1774861501.673111, 'auction_closing_time': 1774970427.0}
2026-03-30 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BP75996') HTTP/1.1" 204 0
2026-03-30 09:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c4fef27-ebc2-5f02-b579-f84c2210f482 with identifier: DY67923
2026-03-30 09:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c4fef27-ebc2-5f02-b579-f84c2210f482 with identifier: DY67923
2026-03-30 09:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c4fef27-ebc2-5f02-b579-f84c2210f482 with identifier: DY67923 to the API
2026-03-30 09:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DY67923>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:54:58Z',
 'fuel_type': 'diesel',
 'id': '6c4fef27-ebc2-5f02-b579-f84c2210f482',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY67923',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 101011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_9fca5262da7b081a13fed3a5b8ef0d22.jpg',
                'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_c9d67539572519a1628c4605f9a61e1a.jpg',
                'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_adb482fbd57c1fd032e5f2dd1c80ce81.jpg',
                'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_20130615dc48aaa8638d31538fced437.jpg',
                'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_d77bb0079ff7f6d6a61b5187f7509f23.jpg',
                'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_5959143a30f888ae8a887d13ae70adaf.jpg',
                'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_e386dbf3ffcdbd9b9505073210a0bd7a.jpg',
                'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_ce249a303c1899be7d87eed27aa2c4e8.jpg',
                'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_e28bac39b258933db7d163bbb511784e.jpg',
                'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_d92c3162d603b260558f741c0dcf251c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c4fef27-ebc2-5f02-b579-f84c2210f482/6c4fef27-ebc2-5f02-b579-f84c2210f482_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2000250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_9fca5262da7b081a13fed3a5b8ef0d22.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c4fef27-ebc2-5f02-b579-f84c2210f482/6c4fef27-ebc2-5f02-b579-f84c2210f482_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_c9d67539572519a1628c4605f9a61e1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c4fef27-ebc2-5f02-b579-f84c2210f482/6c4fef27-ebc2-5f02-b579-f84c2210f482_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_adb482fbd57c1fd032e5f2dd1c80ce81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c4fef27-ebc2-5f02-b579-f84c2210f482/6c4fef27-ebc2-5f02-b579-f84c2210f482_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_20130615dc48aaa8638d31538fced437.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c4fef27-ebc2-5f02-b579-f84c2210f482/6c4fef27-ebc2-5f02-b579-f84c2210f482_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_d77bb0079ff7f6d6a61b5187f7509f23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c4fef27-ebc2-5f02-b579-f84c2210f482/6c4fef27-ebc2-5f02-b579-f84c2210f482_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1917716,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_5959143a30f888ae8a887d13ae70adaf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c4fef27-ebc2-5f02-b579-f84c2210f482/6c4fef27-ebc2-5f02-b579-f84c2210f482_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_e386dbf3ffcdbd9b9505073210a0bd7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c4fef27-ebc2-5f02-b579-f84c2210f482/6c4fef27-ebc2-5f02-b579-f84c2210f482_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_ce249a303c1899be7d87eed27aa2c4e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c4fef27-ebc2-5f02-b579-f84c2210f482/6c4fef27-ebc2-5f02-b579-f84c2210f482_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_e28bac39b258933db7d163bbb511784e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c4fef27-ebc2-5f02-b579-f84c2210f482/6c4fef27-ebc2-5f02-b579-f84c2210f482_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2000222,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/89/aa897c743daf3ff7bfac053601544a04/pa/DY67923_d92c3162d603b260558f741c0dcf251c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Super',
 'transmission': 'automatic',
 'trim': 'Super',
 'year': 2021}
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY67923%27 HTTP/1.1" 200 None
2026-03-30 09:05:02 [auto1.it] INFO: Saving data for DY67923: {'created_time': 1774861502.273859, 'last_price_update_time': 1774861502.273874, 'auction_closing_time': 1774972498.0}
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DY67923') HTTP/1.1" 204 0
2026-03-30 09:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_961526ea95845298a5a253c18970982b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_0d2f370f1c41ab98552333dcdd0c06b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_11f4d10039ab9a5672d1f1365f966ea7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5b62895b-7010-5b17-975f-52a9c4b872b9 with identifier: TK21590
2026-03-30 09:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5b62895b-7010-5b17-975f-52a9c4b872b9 with identifier: TK21590
2026-03-30 09:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5b62895b-7010-5b17-975f-52a9c4b872b9 with identifier: TK21590 to the API
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:51:11Z',
 'fuel_type': 'petrol',
 'id': '5b62895b-7010-5b17-975f-52a9c4b872b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK21590',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 74528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-27',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2023}
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK21590%27 HTTP/1.1" 200 None
2026-03-30 09:05:02 [auto1.it] INFO: Saving data for TK21590: {'auction_closing_time': 1774972271.0, 'created_time': 1774342843.373482, 'last_price_update_time': 1774861502.72082}
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TK21590') HTTP/1.1" 204 0
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_ba502055f5e684ab3bec3b93f879e580.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_ba502055f5e684ab3bec3b93f879e580.jpg not downloaded yet
2026-03-30 09:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC12877/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ER60323/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06caabd0>
2026-03-30 09:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_706316b9347ee99a56d5568214f68a0b.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_706316b9347ee99a56d5568214f68a0b.jpg saved to cache
2026-03-30 09:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f47752c3-4d30-5ecd-baca-78a158010ea5
2026-03-30 09:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 318dee58-be80-58d4-aa95-06a72a41560b with identifier: YF83888
2026-03-30 09:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 318dee58-be80-58d4-aa95-06a72a41560b with scrape type 1
2026-03-30 09:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 318dee58-be80-58d4-aa95-06a72a41560b
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fcf%252F04cff0c61d6d598b4e26484830d9f7b0%252Fpa%252FYF83888_36e414dba8306b55c12f0a04de2d6494.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_36e414dba8306b55c12f0a04de2d6494.jpg already downloaded
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fcf%252F04cff0c61d6d598b4e26484830d9f7b0%252Fpa%252FYF83888_8f92cfb2923fc41952dceec040a27e58.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_8f92cfb2923fc41952dceec040a27e58.jpg already downloaded
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fcf%252F04cff0c61d6d598b4e26484830d9f7b0%252Fpa%252FYF83888_d88e0c3ed746c3c0cde3b0c98be8ac55.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_d88e0c3ed746c3c0cde3b0c98be8ac55.jpg already downloaded
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fcf%252F04cff0c61d6d598b4e26484830d9f7b0%252Fpa%252FYF83888_27c0462a887edc75eb31cea9ac4efe03.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_27c0462a887edc75eb31cea9ac4efe03.jpg already downloaded
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fcf%252F04cff0c61d6d598b4e26484830d9f7b0%252Fpa%252FYF83888_2172b0739efb0d03ea4ad4f950ad0b71.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_2172b0739efb0d03ea4ad4f950ad0b71.jpg already downloaded
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fcf%252F04cff0c61d6d598b4e26484830d9f7b0%252Fpa%252FYF83888_c1048a84c9c7901217768e0dd2895e0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_c1048a84c9c7901217768e0dd2895e0f.jpg already downloaded
2026-03-30 09:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fcf%252F04cff0c61d6d598b4e26484830d9f7b0%252Fpa%252FYF83888_bb3b728fc96ddcb15f0ff214c44324f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_bb3b728fc96ddcb15f0ff214c44324f7.jpg already downloaded
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fcf%252F04cff0c61d6d598b4e26484830d9f7b0%252Fpa%252FYF83888_10c38bf2f334e54bb88dd315a06279bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_10c38bf2f334e54bb88dd315a06279bb.jpg already downloaded
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fcf%252F04cff0c61d6d598b4e26484830d9f7b0%252Fpa%252FYF83888_b2d7bafd52ea8b6b81e037aaa81ec9c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_b2d7bafd52ea8b6b81e037aaa81ec9c8.jpg already downloaded
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fcf%252F04cff0c61d6d598b4e26484830d9f7b0%252Fpa%252FYF83888_d495c28cf37fcefe146c4993777640f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_d495c28cf37fcefe146c4993777640f3.jpg already downloaded
2026-03-30 09:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 318dee58-be80-58d4-aa95-06a72a41560b, identifier: YF83888
2026-03-30 09:05:03 [auto1.it] INFO: Found listing with ID: BZ92290
2026-03-30 09:05:03 [auto1.it] INFO: Found listing with ID: CY38939
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY38939%27 HTTP/1.1" 200 None
2026-03-30 09:05:03 [auto1.it] INFO: Scrape type for CY38939: 1
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_00b1c6e6be75839de20428c53cccb871.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_00b1c6e6be75839de20428c53cccb871.jpg not downloaded yet
2026-03-30 09:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 318dee58-be80-58d4-aa95-06a72a41560b with identifier: YF83888
2026-03-30 09:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 318dee58-be80-58d4-aa95-06a72a41560b with identifier: YF83888
2026-03-30 09:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 318dee58-be80-58d4-aa95-06a72a41560b with identifier: YF83888 to the API
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YF83888>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:35:40Z',
 'fuel_type': 'petrol',
 'id': '318dee58-be80-58d4-aa95-06a72a41560b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF83888',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 95122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_36e414dba8306b55c12f0a04de2d6494.jpg',
                'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_8f92cfb2923fc41952dceec040a27e58.jpg',
                'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_d88e0c3ed746c3c0cde3b0c98be8ac55.jpg',
                'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_27c0462a887edc75eb31cea9ac4efe03.jpg',
                'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_2172b0739efb0d03ea4ad4f950ad0b71.jpg',
                'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_c1048a84c9c7901217768e0dd2895e0f.jpg',
                'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_bb3b728fc96ddcb15f0ff214c44324f7.jpg',
                'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_10c38bf2f334e54bb88dd315a06279bb.jpg',
                'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_b2d7bafd52ea8b6b81e037aaa81ec9c8.jpg',
                'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_d495c28cf37fcefe146c4993777640f3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318dee58-be80-58d4-aa95-06a72a41560b/318dee58-be80-58d4-aa95-06a72a41560b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_36e414dba8306b55c12f0a04de2d6494.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318dee58-be80-58d4-aa95-06a72a41560b/318dee58-be80-58d4-aa95-06a72a41560b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2187805,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_8f92cfb2923fc41952dceec040a27e58.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318dee58-be80-58d4-aa95-06a72a41560b/318dee58-be80-58d4-aa95-06a72a41560b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_d88e0c3ed746c3c0cde3b0c98be8ac55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318dee58-be80-58d4-aa95-06a72a41560b/318dee58-be80-58d4-aa95-06a72a41560b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_27c0462a887edc75eb31cea9ac4efe03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318dee58-be80-58d4-aa95-06a72a41560b/318dee58-be80-58d4-aa95-06a72a41560b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2069267,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_2172b0739efb0d03ea4ad4f950ad0b71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318dee58-be80-58d4-aa95-06a72a41560b/318dee58-be80-58d4-aa95-06a72a41560b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_c1048a84c9c7901217768e0dd2895e0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318dee58-be80-58d4-aa95-06a72a41560b/318dee58-be80-58d4-aa95-06a72a41560b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1999344,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_bb3b728fc96ddcb15f0ff214c44324f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318dee58-be80-58d4-aa95-06a72a41560b/318dee58-be80-58d4-aa95-06a72a41560b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2294156,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_10c38bf2f334e54bb88dd315a06279bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318dee58-be80-58d4-aa95-06a72a41560b/318dee58-be80-58d4-aa95-06a72a41560b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_b2d7bafd52ea8b6b81e037aaa81ec9c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318dee58-be80-58d4-aa95-06a72a41560b/318dee58-be80-58d4-aa95-06a72a41560b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/cf/04cff0c61d6d598b4e26484830d9f7b0/pa/YF83888_d495c28cf37fcefe146c4993777640f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 e-VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF83888%27 HTTP/1.1" 200 None
2026-03-30 09:05:03 [auto1.it] INFO: Saving data for YF83888: {'created_time': 1774861503.598624, 'last_price_update_time': 1774861503.598635, 'auction_closing_time': 1774971340.0}
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YF83888') HTTP/1.1" 204 0
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_e8ff7bb39992f575e22675a14af696e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_e8ff7bb39992f575e22675a14af696e2.jpg not downloaded yet
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c76610>
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_e3df93f65c076b720b5fdd0b87d90b61.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_e3df93f65c076b720b5fdd0b87d90b61.jpg saved to cache
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3894e5d6-f6df-53e3-89d9-a84134c634d2
2026-03-30 09:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_212be9cba6ee787ce8ec964bff65489d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:03 [auto1.it] INFO: Found listing with ID: GB25673
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB25673%27 HTTP/1.1" 200 None
2026-03-30 09:05:03 [auto1.it] INFO: Scrape type for GB25673: 1
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_b4bafed002b7f56cde419b49ce740722.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_b4bafed002b7f56cde419b49ce740722.jpg not downloaded yet
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062edad0>
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_961526ea95845298a5a253c18970982b.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_961526ea95845298a5a253c18970982b.jpg saved to cache
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3894e5d6-f6df-53e3-89d9-a84134c634d2
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06363710>
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_0d2f370f1c41ab98552333dcdd0c06b9.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_0d2f370f1c41ab98552333dcdd0c06b9.jpg saved to cache
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f47752c3-4d30-5ecd-baca-78a158010ea5
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06def890>
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_11f4d10039ab9a5672d1f1365f966ea7.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_11f4d10039ab9a5672d1f1365f966ea7.jpg saved to cache
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f47752c3-4d30-5ecd-baca-78a158010ea5
2026-03-30 09:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_dd1450349f15c46ae4a7e770a601ff28.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_11be970c4c3618bb44ffc2a9f5335959.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_11be970c4c3618bb44ffc2a9f5335959.jpg not downloaded yet
2026-03-30 09:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH20956> (referer: https://www.auto1.com/v1/car-details-view/ZH20956/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:03 [auto1.it] INFO: Found listing with ID: VP57623
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP57623%27 HTTP/1.1" 200 None
2026-03-30 09:05:03 [auto1.it] INFO: Scrape type for VP57623: 1
2026-03-30 09:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_e964915b2dc3f3ced81aebb0b852a87d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_6984023a8a593be9dec3036e1c245072.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_b3fc17ea7ff0a90b1a1d8616277fd7b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_b3fc17ea7ff0a90b1a1d8616277fd7b6.jpg not downloaded yet
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06363150>
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_212be9cba6ee787ce8ec964bff65489d.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_212be9cba6ee787ce8ec964bff65489d.jpg saved to cache
2026-03-30 09:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f47752c3-4d30-5ecd-baca-78a158010ea5
2026-03-30 09:05:04 [auto1.it] INFO: Found listing with ID: RF81077
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF81077%27 HTTP/1.1" 200 None
2026-03-30 09:05:04 [auto1.it] INFO: Scrape type for RF81077: 1
2026-03-30 09:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_00b1c6e6be75839de20428c53cccb871.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_e8ff7bb39992f575e22675a14af696e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:04 [scrapy.extensions.logstats] INFO: Crawled 215 pages (at 60 pages/min), scraped 345 items (at 68 items/min)
2026-03-30 09:05:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 198MiB
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_9134262e250a2dbd3e7a296a0a55d2a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_9134262e250a2dbd3e7a296a0a55d2a6.jpg not downloaded yet
2026-03-30 09:05:04 [auto1.it] INFO: Found listing with ID: TB87558
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB87558%27 HTTP/1.1" 200 None
2026-03-30 09:05:04 [auto1.it] INFO: Scrape type for TB87558: 2
2026-03-30 09:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db06d04d-0302-5ba4-ae84-666ef097c054 with identifier: TB87558
2026-03-30 09:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db06d04d-0302-5ba4-ae84-666ef097c054 with scrape type 2
2026-03-30 09:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db06d04d-0302-5ba4-ae84-666ef097c054 with scrape type 2
2026-03-30 09:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: db06d04d-0302-5ba4-ae84-666ef097c054, identifier: TB87558
2026-03-30 09:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063917d0>
2026-03-30 09:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_dd1450349f15c46ae4a7e770a601ff28.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_dd1450349f15c46ae4a7e770a601ff28.jpg saved to cache
2026-03-30 09:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f23c2758-3cf7-594f-a099-9521d3244bb4
2026-03-30 09:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: db06d04d-0302-5ba4-ae84-666ef097c054 with identifier: TB87558
2026-03-30 09:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: db06d04d-0302-5ba4-ae84-666ef097c054 with identifier: TB87558
2026-03-30 09:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: db06d04d-0302-5ba4-ae84-666ef097c054 with identifier: TB87558 to the API
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:12:29Z',
 'fuel_type': 'diesel',
 'id': 'db06d04d-0302-5ba4-ae84-666ef097c054',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB87558',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 94969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-06',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2020}
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB87558%27 HTTP/1.1" 200 None
2026-03-30 09:05:04 [auto1.it] INFO: Saving data for TB87558: {'auction_closing_time': 1774969949.0, 'created_time': 1773135835.925393, 'last_price_update_time': 1774861504.718129}
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TB87558') HTTP/1.1" 204 0
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_ef77b0df4b94b5aa822afd1c160bbca9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_ef77b0df4b94b5aa822afd1c160bbca9.jpg not downloaded yet
2026-03-30 09:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_11be970c4c3618bb44ffc2a9f5335959.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:04 [auto1.it] INFO: Found listing with ID: BG63942
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG63942%27 HTTP/1.1" 200 None
2026-03-30 09:05:04 [auto1.it] INFO: Scrape type for BG63942: 2
2026-03-30 09:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2cf5e53-64c9-5fec-a614-bc2ce3a27637 with identifier: BG63942
2026-03-30 09:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2cf5e53-64c9-5fec-a614-bc2ce3a27637 with scrape type 2
2026-03-30 09:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2cf5e53-64c9-5fec-a614-bc2ce3a27637 with scrape type 2
2026-03-30 09:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c2cf5e53-64c9-5fec-a614-bc2ce3a27637, identifier: BG63942
2026-03-30 09:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c16e0be7-5c56-52e8-a902-71a1318b4aed with identifier: ZH20956
2026-03-30 09:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c16e0be7-5c56-52e8-a902-71a1318b4aed with scrape type 1
2026-03-30 09:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c16e0be7-5c56-52e8-a902-71a1318b4aed
2026-03-30 09:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_328798b298272eda1fd51567fd9967cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_328798b298272eda1fd51567fd9967cc.jpg not downloaded yet
2026-03-30 09:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06defdd0>
2026-03-30 09:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_e964915b2dc3f3ced81aebb0b852a87d.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_e964915b2dc3f3ced81aebb0b852a87d.jpg saved to cache
2026-03-30 09:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f285b5e-287c-5b36-81f7-13f383e6dcde
2026-03-30 09:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0627d250>
2026-03-30 09:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_6984023a8a593be9dec3036e1c245072.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_6984023a8a593be9dec3036e1c245072.jpg saved to cache
2026-03-30 09:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f47752c3-4d30-5ecd-baca-78a158010ea5
2026-03-30 09:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_b3fc17ea7ff0a90b1a1d8616277fd7b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c2cf5e53-64c9-5fec-a614-bc2ce3a27637 with identifier: BG63942
2026-03-30 09:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c2cf5e53-64c9-5fec-a614-bc2ce3a27637 with identifier: BG63942
2026-03-30 09:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c2cf5e53-64c9-5fec-a614-bc2ce3a27637 with identifier: BG63942 to the API
2026-03-30 09:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:33:36Z',
 'fuel_type': 'diesel',
 'id': 'c2cf5e53-64c9-5fec-a614-bc2ce3a27637',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG63942',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 130893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG63942%27 HTTP/1.1" 200 None
2026-03-30 09:05:06 [auto1.it] INFO: Saving data for BG63942: {'auction_closing_time': 1774971216.0, 'created_time': 1774267275.454028, 'last_price_update_time': 1774861506.463758}
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BG63942') HTTP/1.1" 204 0
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_e3f598681b4bec0d93c48401ebe47d76.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_e3f598681b4bec0d93c48401ebe47d76.jpg not downloaded yet
2026-03-30 09:05:06 [auto1.it] INFO: Found listing with ID: FP39081
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP39081%27 HTTP/1.1" 200 None
2026-03-30 09:05:06 [auto1.it] INFO: Scrape type for FP39081: 2
2026-03-30 09:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2802434f-70da-56a7-bf6e-a259fd03cf10 with identifier: FP39081
2026-03-30 09:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2802434f-70da-56a7-bf6e-a259fd03cf10 with scrape type 2
2026-03-30 09:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2802434f-70da-56a7-bf6e-a259fd03cf10 with scrape type 2
2026-03-30 09:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2802434f-70da-56a7-bf6e-a259fd03cf10, identifier: FP39081
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_43a013be1030deb3134eedafdc7559b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_43a013be1030deb3134eedafdc7559b2.jpg not downloaded yet
2026-03-30 09:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fc5010>
2026-03-30 09:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_00b1c6e6be75839de20428c53cccb871.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_00b1c6e6be75839de20428c53cccb871.jpg saved to cache
2026-03-30 09:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f47752c3-4d30-5ecd-baca-78a158010ea5
2026-03-30 09:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06deef90>
2026-03-30 09:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_e8ff7bb39992f575e22675a14af696e2.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_e8ff7bb39992f575e22675a14af696e2.jpg saved to cache
2026-03-30 09:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f23c2758-3cf7-594f-a099-9521d3244bb4
2026-03-30 09:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2802434f-70da-56a7-bf6e-a259fd03cf10 with identifier: FP39081
2026-03-30 09:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2802434f-70da-56a7-bf6e-a259fd03cf10 with identifier: FP39081
2026-03-30 09:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2802434f-70da-56a7-bf6e-a259fd03cf10 with identifier: FP39081 to the API
2026-03-30 09:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:36:41Z',
 'fuel_type': 'diesel',
 'id': '2802434f-70da-56a7-bf6e-a259fd03cf10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP39081',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 135035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-20',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 d T BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'T BlueTEC AMG Line',
 'year': 2017}
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP39081%27 HTTP/1.1" 200 None
2026-03-30 09:05:07 [auto1.it] INFO: Saving data for FP39081: {'auction_closing_time': 1774971401.0, 'created_time': 1774645494.630307, 'last_price_update_time': 1774861507.148065}
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FP39081') HTTP/1.1" 204 0
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_03b56df0f458fb862d364bdff097e97e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_03b56df0f458fb862d364bdff097e97e.jpg not downloaded yet
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c67010>
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_11be970c4c3618bb44ffc2a9f5335959.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_11be970c4c3618bb44ffc2a9f5335959.jpg saved to cache
2026-03-30 09:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f23c2758-3cf7-594f-a099-9521d3244bb4
2026-03-30 09:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_9134262e250a2dbd3e7a296a0a55d2a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:07 [auto1.it] INFO: Found listing with ID: JK72241
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK72241%27 HTTP/1.1" 200 None
2026-03-30 09:05:07 [auto1.it] INFO: Scrape type for JK72241: 2
2026-03-30 09:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3f1807f-4f03-5194-be5d-75b069013e24 with identifier: JK72241
2026-03-30 09:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3f1807f-4f03-5194-be5d-75b069013e24 with scrape type 2
2026-03-30 09:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3f1807f-4f03-5194-be5d-75b069013e24 with scrape type 2
2026-03-30 09:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3f1807f-4f03-5194-be5d-75b069013e24, identifier: JK72241
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_0799b53e66dbac3268a85602ee8cbdfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_0799b53e66dbac3268a85602ee8cbdfa.jpg not downloaded yet
2026-03-30 09:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH14156/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_ef77b0df4b94b5aa822afd1c160bbca9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3f1807f-4f03-5194-be5d-75b069013e24 with identifier: JK72241
2026-03-30 09:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3f1807f-4f03-5194-be5d-75b069013e24 with identifier: JK72241
2026-03-30 09:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3f1807f-4f03-5194-be5d-75b069013e24 with identifier: JK72241 to the API
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:17:23Z',
 'fuel_type': 'diesel',
 'id': 'e3f1807f-4f03-5194-be5d-75b069013e24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK72241',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 231970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-28',
 'seller_name': None,
 'title': 'Audi A4 Allroad 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK72241%27 HTTP/1.1" 200 None
2026-03-30 09:05:07 [auto1.it] INFO: Saving data for JK72241: {'auction_closing_time': 1774970243.0, 'created_time': 1774267347.177055, 'last_price_update_time': 1774861507.76569}
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JK72241') HTTP/1.1" 204 0
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_a1e58ce70d8c32d64b5a355a1c4d3a02.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_a1e58ce70d8c32d64b5a355a1c4d3a02.jpg not downloaded yet
2026-03-30 09:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fc7f10>
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_b3fc17ea7ff0a90b1a1d8616277fd7b6.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_b3fc17ea7ff0a90b1a1d8616277fd7b6.jpg saved to cache
2026-03-30 09:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f23c2758-3cf7-594f-a099-9521d3244bb4
2026-03-30 09:05:07 [auto1.it] INFO: Found listing with ID: SV47237
2026-03-30 09:05:07 [auto1.it] INFO: Found listing with ID: BJ56464
2026-03-30 09:05:07 [auto1.it] INFO: Found listing with ID: YM87758
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM87758%27 HTTP/1.1" 200 None
2026-03-30 09:05:07 [auto1.it] INFO: Scrape type for YM87758: 1
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_54c316b3f2112e1b7dd221129c895bad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_54c316b3f2112e1b7dd221129c895bad.jpg not downloaded yet
2026-03-30 09:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC55039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV97878> (referer: https://www.auto1.com/v1/car-details-view/TV97878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:07 [auto1.it] INFO: Found listing with ID: ZZ84284
2026-03-30 09:05:07 [auto1.it] INFO: Found listing with ID: DT80925
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_72053bbdf51805d3ccd906ec5207d2c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_72053bbdf51805d3ccd906ec5207d2c4.jpg not downloaded yet
2026-03-30 09:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB15509> (referer: https://www.auto1.com/v1/car-details-view/GB15509/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0610d950>
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_9134262e250a2dbd3e7a296a0a55d2a6.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_9134262e250a2dbd3e7a296a0a55d2a6.jpg saved to cache
2026-03-30 09:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f23c2758-3cf7-594f-a099-9521d3244bb4
2026-03-30 09:05:07 [auto1.it] INFO: Channel: 24h | Page: 21 | totalHits: 3302 | hits on page: 40
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06394350>
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_ef77b0df4b94b5aa822afd1c160bbca9.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_ef77b0df4b94b5aa822afd1c160bbca9.jpg saved to cache
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f23c2758-3cf7-594f-a099-9521d3244bb4
2026-03-30 09:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_e3f598681b4bec0d93c48401ebe47d76.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_03b56df0f458fb862d364bdff097e97e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_7940d4dacbbdd258c7932780f72a8a52.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_7940d4dacbbdd258c7932780f72a8a52.jpg not downloaded yet
2026-03-30 09:05:08 [auto1.it] INFO: Found listing with ID: ZZ84284
2026-03-30 09:05:08 [auto1.it] INFO: Found listing with ID: DT80925
2026-03-30 09:05:08 [auto1.it] INFO: Found listing with ID: JE22248
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE22248%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [auto1.it] INFO: Scrape type for JE22248: 1
2026-03-30 09:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49cbbbd0-3411-5996-b9be-c7b27fd79677 with identifier: TV97878
2026-03-30 09:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49cbbbd0-3411-5996-b9be-c7b27fd79677 with scrape type 1
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49cbbbd0-3411-5996-b9be-c7b27fd79677
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_51433d691b04f674fe587f6d487bb5d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_51433d691b04f674fe587f6d487bb5d4.jpg not downloaded yet
2026-03-30 09:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_43a013be1030deb3134eedafdc7559b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_328798b298272eda1fd51567fd9967cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_c3ffa042b593d929d7749716db87fa4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_c3ffa042b593d929d7749716db87fa4c.jpg not downloaded yet
2026-03-30 09:05:08 [auto1.it] INFO: Found listing with ID: TK52144
2026-03-30 09:05:08 [auto1.it] INFO: Found listing with ID: WN04356
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN04356%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [auto1.it] INFO: Scrape type for WN04356: 1
2026-03-30 09:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_a1e58ce70d8c32d64b5a355a1c4d3a02.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_35ca8965bedea14707d770d199e4a903.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_35ca8965bedea14707d770d199e4a903.jpg not downloaded yet
2026-03-30 09:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1abf3df3-39de-5392-92a4-7f5c25048b80 with identifier: GB15509
2026-03-30 09:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1abf3df3-39de-5392-92a4-7f5c25048b80 with scrape type 1
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1abf3df3-39de-5392-92a4-7f5c25048b80
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_df435559b65db970fe15e67433bfdbf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_df435559b65db970fe15e67433bfdbf6.jpg not downloaded yet
2026-03-30 09:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_54c316b3f2112e1b7dd221129c895bad.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_58de5a740555c018a8d14ce633009c49.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_58de5a740555c018a8d14ce633009c49.jpg not downloaded yet
2026-03-30 09:05:08 [auto1.it] INFO: Found listing with ID: MV72435
2026-03-30 09:05:08 [auto1.it] INFO: Found listing with ID: DN06430
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN06430%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [auto1.it] INFO: Scrape type for DN06430: 2
2026-03-30 09:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aaf9893-f32a-573d-a4fb-a1f85e4d8e8a with identifier: DN06430
2026-03-30 09:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aaf9893-f32a-573d-a4fb-a1f85e4d8e8a with scrape type 2
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2aaf9893-f32a-573d-a4fb-a1f85e4d8e8a with scrape type 2
2026-03-30 09:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2aaf9893-f32a-573d-a4fb-a1f85e4d8e8a, identifier: DN06430
2026-03-30 09:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2aaf9893-f32a-573d-a4fb-a1f85e4d8e8a with identifier: DN06430
2026-03-30 09:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2aaf9893-f32a-573d-a4fb-a1f85e4d8e8a with identifier: DN06430
2026-03-30 09:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2aaf9893-f32a-573d-a4fb-a1f85e4d8e8a with identifier: DN06430 to the API
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:17:25Z',
 'fuel_type': 'diesel',
 'id': '2aaf9893-f32a-573d-a4fb-a1f85e4d8e8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN06430',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 245181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-09',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN06430%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [auto1.it] INFO: Saving data for DN06430: {'auction_closing_time': 1774883845.0, 'created_time': 1774526576.26106, 'last_price_update_time': 1774861508.633589}
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DN06430') HTTP/1.1" 204 0
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_b9fb6582fa0171929119d8db6003b6fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_b9fb6582fa0171929119d8db6003b6fe.jpg not downloaded yet
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_4e44b4bbb3f1c4cb022d081afcf3860c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_4e44b4bbb3f1c4cb022d081afcf3860c.jpg not downloaded yet
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_1426b9320f137ec1f12c579940f87b41.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_1426b9320f137ec1f12c579940f87b41.jpg not downloaded yet
2026-03-30 09:05:08 [auto1.it] INFO: Found listing with ID: DB48039
2026-03-30 09:05:08 [auto1.it] INFO: Found listing with ID: PG30215
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG30215%27 HTTP/1.1" 200 None
2026-03-30 09:05:08 [auto1.it] INFO: Scrape type for PG30215: 2
2026-03-30 09:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 085b8496-f1bc-5895-91b7-4807b63492da with identifier: PG30215
2026-03-30 09:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 085b8496-f1bc-5895-91b7-4807b63492da with scrape type 2
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 085b8496-f1bc-5895-91b7-4807b63492da with scrape type 2
2026-03-30 09:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 085b8496-f1bc-5895-91b7-4807b63492da, identifier: PG30215
2026-03-30 09:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d49a50>
2026-03-30 09:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_e3f598681b4bec0d93c48401ebe47d76.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_e3f598681b4bec0d93c48401ebe47d76.jpg saved to cache
2026-03-30 09:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f23c2758-3cf7-594f-a099-9521d3244bb4
2026-03-30 09:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ea0990>
2026-03-30 09:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_03b56df0f458fb862d364bdff097e97e.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_03b56df0f458fb862d364bdff097e97e.jpg saved to cache
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f23c2758-3cf7-594f-a099-9521d3244bb4
2026-03-30 09:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_e4d580fa08bdbec24f50410952500091.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 085b8496-f1bc-5895-91b7-4807b63492da with identifier: PG30215
2026-03-30 09:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 085b8496-f1bc-5895-91b7-4807b63492da with identifier: PG30215
2026-03-30 09:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 085b8496-f1bc-5895-91b7-4807b63492da with identifier: PG30215 to the API
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:07:08Z',
 'fuel_type': 'petrol',
 'id': '085b8496-f1bc-5895-91b7-4807b63492da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG30215',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 69331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-18',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG30215%27 HTTP/1.1" 200 None
2026-03-30 09:05:09 [auto1.it] INFO: Saving data for PG30215: {'auction_closing_time': 1774883228.0, 'created_time': 1774774830.829065, 'last_price_update_time': 1774861509.359895}
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PG30215') HTTP/1.1" 204 0
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_993d660b9b5b6ae241d8600622be3e65.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_993d660b9b5b6ae241d8600622be3e65.jpg not downloaded yet
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_42c9d3b202e2d7c02204ea9c35100fb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_42c9d3b202e2d7c02204ea9c35100fb6.jpg not downloaded yet
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_1e6039c55ef96fd7c6d8b86651c1cf31.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_1e6039c55ef96fd7c6d8b86651c1cf31.jpg not downloaded yet
2026-03-30 09:05:09 [auto1.it] INFO: Found listing with ID: HJ29626
2026-03-30 09:05:09 [auto1.it] INFO: Found listing with ID: LE34139
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE34139%27 HTTP/1.1" 200 None
2026-03-30 09:05:09 [auto1.it] INFO: Scrape type for LE34139: 2
2026-03-30 09:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afa77525-02ab-5a26-80f4-2edb4c86f20c with identifier: LE34139
2026-03-30 09:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afa77525-02ab-5a26-80f4-2edb4c86f20c with scrape type 2
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afa77525-02ab-5a26-80f4-2edb4c86f20c with scrape type 2
2026-03-30 09:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: afa77525-02ab-5a26-80f4-2edb4c86f20c, identifier: LE34139
2026-03-30 09:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ER60323> (referer: https://www.auto1.com/v1/car-details-view/ER60323/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0611a890>
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_43a013be1030deb3134eedafdc7559b2.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_43a013be1030deb3134eedafdc7559b2.jpg saved to cache
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c16e0be7-5c56-52e8-a902-71a1318b4aed
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ca5cd0>
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_328798b298272eda1fd51567fd9967cc.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_328798b298272eda1fd51567fd9967cc.jpg saved to cache
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c16e0be7-5c56-52e8-a902-71a1318b4aed
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062bf110>
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_a1e58ce70d8c32d64b5a355a1c4d3a02.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_a1e58ce70d8c32d64b5a355a1c4d3a02.jpg saved to cache
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f23c2758-3cf7-594f-a099-9521d3244bb4
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fe7c50>
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_54c316b3f2112e1b7dd221129c895bad.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_54c316b3f2112e1b7dd221129c895bad.jpg saved to cache
2026-03-30 09:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c16e0be7-5c56-52e8-a902-71a1318b4aed
2026-03-30 09:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_51433d691b04f674fe587f6d487bb5d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: afa77525-02ab-5a26-80f4-2edb4c86f20c with identifier: LE34139
2026-03-30 09:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: afa77525-02ab-5a26-80f4-2edb4c86f20c with identifier: LE34139
2026-03-30 09:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: afa77525-02ab-5a26-80f4-2edb4c86f20c with identifier: LE34139 to the API
2026-03-30 09:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:28:02Z',
 'fuel_type': 'diesel',
 'id': 'afa77525-02ab-5a26-80f4-2edb4c86f20c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE34139',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 138578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-27',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTD Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2017}
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE34139%27 HTTP/1.1" 200 None
2026-03-30 09:05:10 [auto1.it] INFO: Saving data for LE34139: {'auction_closing_time': 1774884482.0, 'created_time': 1774774833.328765, 'last_price_update_time': 1774861510.154118}
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LE34139') HTTP/1.1" 204 0
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_098181276a98bc3cf417278041642a98.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_098181276a98bc3cf417278041642a98.jpg not downloaded yet
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_15b0438be866f46c917aefbb3d4a5387.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_15b0438be866f46c917aefbb3d4a5387.jpg not downloaded yet
2026-03-30 09:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG90075> (referer: https://www.auto1.com/v1/car-details-view/LG90075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:10 [auto1.it] INFO: Found listing with ID: WA17168
2026-03-30 09:05:10 [auto1.it] INFO: Found listing with ID: NW33214
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW33214%27 HTTP/1.1" 200 None
2026-03-30 09:05:10 [auto1.it] INFO: Scrape type for NW33214: 2
2026-03-30 09:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3918121d-8c64-5911-8c92-361164a9fd12 with identifier: NW33214
2026-03-30 09:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3918121d-8c64-5911-8c92-361164a9fd12 with scrape type 2
2026-03-30 09:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3918121d-8c64-5911-8c92-361164a9fd12 with scrape type 2
2026-03-30 09:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3918121d-8c64-5911-8c92-361164a9fd12, identifier: NW33214
2026-03-30 09:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c2a9d0>
2026-03-30 09:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_e4d580fa08bdbec24f50410952500091.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_e4d580fa08bdbec24f50410952500091.jpg saved to cache
2026-03-30 09:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f285b5e-287c-5b36-81f7-13f383e6dcde
2026-03-30 09:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3918121d-8c64-5911-8c92-361164a9fd12 with identifier: NW33214
2026-03-30 09:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3918121d-8c64-5911-8c92-361164a9fd12 with identifier: NW33214
2026-03-30 09:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3918121d-8c64-5911-8c92-361164a9fd12 with identifier: NW33214 to the API
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:50:45Z',
 'fuel_type': 'petrol',
 'id': '3918121d-8c64-5911-8c92-361164a9fd12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW33214',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 204625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-30',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 LX',
 'transmission': 'manual',
 'trim': 'LX',
 'year': 2008}
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW33214%27 HTTP/1.1" 200 None
2026-03-30 09:05:10 [auto1.it] INFO: Saving data for NW33214: {'auction_closing_time': 1774885845.0, 'created_time': 1774559062.337635, 'last_price_update_time': 1774861510.837453}
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NW33214') HTTP/1.1" 204 0
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_d85a75f5c321573bbe969ed7dffc811f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_d85a75f5c321573bbe969ed7dffc811f.jpg not downloaded yet
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_812ae91b7e63e219dff51b59b74e998f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_812ae91b7e63e219dff51b59b74e998f.jpg not downloaded yet
2026-03-30 09:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC12877> (referer: https://www.auto1.com/v1/car-details-view/ZC12877/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b40583e-73ec-54e1-b1a6-341d31471a97 with identifier: ER60323
2026-03-30 09:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b40583e-73ec-54e1-b1a6-341d31471a97 with scrape type 1
2026-03-30 09:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3b40583e-73ec-54e1-b1a6-341d31471a97
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd0%252F16d0c62fadf2652d2c79ceb828c7cbdf%252Fpa%252FER60323_14027d7a86426c7b0da28f5b6378c770.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_14027d7a86426c7b0da28f5b6378c770.jpg already downloaded
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd0%252F16d0c62fadf2652d2c79ceb828c7cbdf%252Fpa%252FER60323_e9d4742047de7bf8a44c1a807e56867d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_e9d4742047de7bf8a44c1a807e56867d.jpg already downloaded
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd0%252F16d0c62fadf2652d2c79ceb828c7cbdf%252Fpa%252FER60323_fdf462baa143894c37ced7ec55e8978f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_fdf462baa143894c37ced7ec55e8978f.jpg already downloaded
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd0%252F16d0c62fadf2652d2c79ceb828c7cbdf%252Fpa%252FER60323_714e50c11fd3002b5d74da64dda256c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_714e50c11fd3002b5d74da64dda256c5.jpg already downloaded
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd0%252F16d0c62fadf2652d2c79ceb828c7cbdf%252Fpa%252FER60323_ab5692d834256f0ccf7f3291909dcdf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_ab5692d834256f0ccf7f3291909dcdf1.jpg already downloaded
2026-03-30 09:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b40583e-73ec-54e1-b1a6-341d31471a97, identifier: ER60323
2026-03-30 09:05:11 [auto1.it] INFO: Found listing with ID: HM75417
2026-03-30 09:05:11 [auto1.it] INFO: Found listing with ID: KM60643
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM60643%27 HTTP/1.1" 200 None
2026-03-30 09:05:11 [auto1.it] INFO: Scrape type for KM60643: 2
2026-03-30 09:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71543d99-05d4-5408-a5cc-87f1a29937a3 with identifier: KM60643
2026-03-30 09:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71543d99-05d4-5408-a5cc-87f1a29937a3 with scrape type 2
2026-03-30 09:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71543d99-05d4-5408-a5cc-87f1a29937a3 with scrape type 2
2026-03-30 09:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 71543d99-05d4-5408-a5cc-87f1a29937a3, identifier: KM60643
2026-03-30 09:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP57623/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b40583e-73ec-54e1-b1a6-341d31471a97 with identifier: ER60323
2026-03-30 09:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b40583e-73ec-54e1-b1a6-341d31471a97 with identifier: ER60323
2026-03-30 09:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b40583e-73ec-54e1-b1a6-341d31471a97 with identifier: ER60323 to the API
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ER60323>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.2L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:09:28Z',
 'fuel_type': 'diesel',
 'id': '3b40583e-73ec-54e1-b1a6-341d31471a97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER60323',
 'listing': 'auction',
 'location': 'Roma RM',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 188996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_14027d7a86426c7b0da28f5b6378c770.jpg',
                'https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_e9d4742047de7bf8a44c1a807e56867d.jpg',
                'https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_fdf462baa143894c37ced7ec55e8978f.jpg',
                'https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_714e50c11fd3002b5d74da64dda256c5.jpg',
                'https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_ab5692d834256f0ccf7f3291909dcdf1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b40583e-73ec-54e1-b1a6-341d31471a97/3b40583e-73ec-54e1-b1a6-341d31471a97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_14027d7a86426c7b0da28f5b6378c770.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b40583e-73ec-54e1-b1a6-341d31471a97/3b40583e-73ec-54e1-b1a6-341d31471a97_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_e9d4742047de7bf8a44c1a807e56867d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b40583e-73ec-54e1-b1a6-341d31471a97/3b40583e-73ec-54e1-b1a6-341d31471a97_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_fdf462baa143894c37ced7ec55e8978f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b40583e-73ec-54e1-b1a6-341d31471a97/3b40583e-73ec-54e1-b1a6-341d31471a97_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_714e50c11fd3002b5d74da64dda256c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b40583e-73ec-54e1-b1a6-341d31471a97/3b40583e-73ec-54e1-b1a6-341d31471a97_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d0/16d0c62fadf2652d2c79ceb828c7cbdf/pa/ER60323_ab5692d834256f0ccf7f3291909dcdf1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda CR-V 2.2 CTDI Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2007}
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER60323%27 HTTP/1.1" 200 None
2026-03-30 09:05:11 [auto1.it] INFO: Saving data for ER60323: {'created_time': 1774861511.576176, 'last_price_update_time': 1774861511.576188, 'auction_closing_time': 1774969768.0}
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ER60323') HTTP/1.1" 204 0
2026-03-30 09:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 71543d99-05d4-5408-a5cc-87f1a29937a3 with identifier: KM60643
2026-03-30 09:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 71543d99-05d4-5408-a5cc-87f1a29937a3 with identifier: KM60643
2026-03-30 09:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 71543d99-05d4-5408-a5cc-87f1a29937a3 with identifier: KM60643 to the API
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:06:47Z',
 'fuel_type': 'diesel',
 'id': '71543d99-05d4-5408-a5cc-87f1a29937a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM60643',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 183199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-05',
 'seller_name': None,
 'title': 'Audi A3 1.9 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2002}
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM60643%27 HTTP/1.1" 200 None
2026-03-30 09:05:11 [auto1.it] INFO: Saving data for KM60643: {'auction_closing_time': 1774883207.0, 'created_time': 1774645502.388695, 'last_price_update_time': 1774861511.870854}
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM60643') HTTP/1.1" 204 0
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_d73caba008c94625b85c63c7a12798e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_d73caba008c94625b85c63c7a12798e9.jpg not downloaded yet
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_3ceab899acc54f3e2585806bf1317382.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_3ceab899acc54f3e2585806bf1317382.jpg not downloaded yet
2026-03-30 09:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f5fdd0>
2026-03-30 09:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_51433d691b04f674fe587f6d487bb5d4.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_51433d691b04f674fe587f6d487bb5d4.jpg saved to cache
2026-03-30 09:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49cbbbd0-3411-5996-b9be-c7b27fd79677
2026-03-30 09:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e077b0d-4a67-5674-9bdd-9682d280214a with identifier: LG90075
2026-03-30 09:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e077b0d-4a67-5674-9bdd-9682d280214a with scrape type 1
2026-03-30 09:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e077b0d-4a67-5674-9bdd-9682d280214a
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F2e%252F1f2ea6444fc628de0f60966777b95a4a%252Fpa%252FLG90075_68b7c385ea96990b04aac2fb656b2e63.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_68b7c385ea96990b04aac2fb656b2e63.jpg already downloaded
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F2e%252F1f2ea6444fc628de0f60966777b95a4a%252Fpa%252FLG90075_3c3c04db117f5b10298bbdc65552efd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_3c3c04db117f5b10298bbdc65552efd0.jpg already downloaded
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F2e%252F1f2ea6444fc628de0f60966777b95a4a%252Fpa%252FLG90075_9ee4c03cd22f192db9b04d5d34716b7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_9ee4c03cd22f192db9b04d5d34716b7c.jpg already downloaded
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F2e%252F1f2ea6444fc628de0f60966777b95a4a%252Fpa%252FLG90075_16ff5062083fe0048450c932b729488f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_16ff5062083fe0048450c932b729488f.jpg already downloaded
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F2e%252F1f2ea6444fc628de0f60966777b95a4a%252Fpa%252FLG90075_5003ac896628e28a7f72592aad581464.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_5003ac896628e28a7f72592aad581464.jpg already downloaded
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F2e%252F1f2ea6444fc628de0f60966777b95a4a%252Fpa%252FLG90075_2c1a09a0f5a9c613fc943a4434a3f10e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_2c1a09a0f5a9c613fc943a4434a3f10e.jpg already downloaded
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F2e%252F1f2ea6444fc628de0f60966777b95a4a%252Fpa%252FLG90075_628ecd6f2726d7d9520828491cb654c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_628ecd6f2726d7d9520828491cb654c7.jpg already downloaded
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F2e%252F1f2ea6444fc628de0f60966777b95a4a%252Fpa%252FLG90075_7ea60e00fb428f66189e2107abe73cca.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_7ea60e00fb428f66189e2107abe73cca.jpg already downloaded
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F2e%252F1f2ea6444fc628de0f60966777b95a4a%252Fpa%252FLG90075_46607c07292d53fbf6ae4084956a07da.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_46607c07292d53fbf6ae4084956a07da.jpg already downloaded
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F2e%252F1f2ea6444fc628de0f60966777b95a4a%252Fpa%252FLG90075_7df800874be12ab2bf9d0f08ed2fc249.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_7df800874be12ab2bf9d0f08ed2fc249.jpg already downloaded
2026-03-30 09:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9e077b0d-4a67-5674-9bdd-9682d280214a, identifier: LG90075
2026-03-30 09:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_993d660b9b5b6ae241d8600622be3e65.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_42c9d3b202e2d7c02204ea9c35100fb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:12 [auto1.it] INFO: Found listing with ID: YJ19643
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ19643%27 HTTP/1.1" 200 None
2026-03-30 09:05:12 [auto1.it] INFO: Scrape type for YJ19643: 2
2026-03-30 09:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 565445c3-e9a8-5604-8565-8b364d248cbd with identifier: YJ19643
2026-03-30 09:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 565445c3-e9a8-5604-8565-8b364d248cbd with scrape type 2
2026-03-30 09:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 565445c3-e9a8-5604-8565-8b364d248cbd with scrape type 2
2026-03-30 09:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 565445c3-e9a8-5604-8565-8b364d248cbd, identifier: YJ19643
2026-03-30 09:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA94787/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH14156> (referer: https://www.auto1.com/v1/car-details-view/ZH14156/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9e077b0d-4a67-5674-9bdd-9682d280214a with identifier: LG90075
2026-03-30 09:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9e077b0d-4a67-5674-9bdd-9682d280214a with identifier: LG90075
2026-03-30 09:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9e077b0d-4a67-5674-9bdd-9682d280214a with identifier: LG90075 to the API
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LG90075>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:41:36Z',
 'fuel_type': 'diesel',
 'id': '9e077b0d-4a67-5674-9bdd-9682d280214a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG90075',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Volkswagen',
 'model': 'Passat CC',
 'odometer': 225136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_68b7c385ea96990b04aac2fb656b2e63.jpg',
                'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_3c3c04db117f5b10298bbdc65552efd0.jpg',
                'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_9ee4c03cd22f192db9b04d5d34716b7c.jpg',
                'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_16ff5062083fe0048450c932b729488f.jpg',
                'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_5003ac896628e28a7f72592aad581464.jpg',
                'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_2c1a09a0f5a9c613fc943a4434a3f10e.jpg',
                'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_628ecd6f2726d7d9520828491cb654c7.jpg',
                'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_7ea60e00fb428f66189e2107abe73cca.jpg',
                'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_46607c07292d53fbf6ae4084956a07da.jpg',
                'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_7df800874be12ab2bf9d0f08ed2fc249.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e077b0d-4a67-5674-9bdd-9682d280214a/9e077b0d-4a67-5674-9bdd-9682d280214a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_68b7c385ea96990b04aac2fb656b2e63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e077b0d-4a67-5674-9bdd-9682d280214a/9e077b0d-4a67-5674-9bdd-9682d280214a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2553183,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_3c3c04db117f5b10298bbdc65552efd0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e077b0d-4a67-5674-9bdd-9682d280214a/9e077b0d-4a67-5674-9bdd-9682d280214a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608043,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_9ee4c03cd22f192db9b04d5d34716b7c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e077b0d-4a67-5674-9bdd-9682d280214a/9e077b0d-4a67-5674-9bdd-9682d280214a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_16ff5062083fe0048450c932b729488f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e077b0d-4a67-5674-9bdd-9682d280214a/9e077b0d-4a67-5674-9bdd-9682d280214a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2589867,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_5003ac896628e28a7f72592aad581464.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e077b0d-4a67-5674-9bdd-9682d280214a/9e077b0d-4a67-5674-9bdd-9682d280214a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_2c1a09a0f5a9c613fc943a4434a3f10e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e077b0d-4a67-5674-9bdd-9682d280214a/9e077b0d-4a67-5674-9bdd-9682d280214a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_628ecd6f2726d7d9520828491cb654c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e077b0d-4a67-5674-9bdd-9682d280214a/9e077b0d-4a67-5674-9bdd-9682d280214a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2575647,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_7ea60e00fb428f66189e2107abe73cca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e077b0d-4a67-5674-9bdd-9682d280214a/9e077b0d-4a67-5674-9bdd-9682d280214a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2579379,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_46607c07292d53fbf6ae4084956a07da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e077b0d-4a67-5674-9bdd-9682d280214a/9e077b0d-4a67-5674-9bdd-9682d280214a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/2e/1f2ea6444fc628de0f60966777b95a4a/pa/LG90075_7df800874be12ab2bf9d0f08ed2fc249.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat CC 2.0 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2011}
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG90075%27 HTTP/1.1" 200 None
2026-03-30 09:05:12 [auto1.it] INFO: Saving data for LG90075: {'created_time': 1774861512.75064, 'last_price_update_time': 1774861512.750651, 'auction_closing_time': 1774971696.0}
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG90075') HTTP/1.1" 204 0
2026-03-30 09:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_1e6039c55ef96fd7c6d8b86651c1cf31.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 565445c3-e9a8-5604-8565-8b364d248cbd with identifier: YJ19643
2026-03-30 09:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 565445c3-e9a8-5604-8565-8b364d248cbd with identifier: YJ19643
2026-03-30 09:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 565445c3-e9a8-5604-8565-8b364d248cbd with identifier: YJ19643 to the API
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:18Z',
 'fuel_type': 'petrol',
 'id': '565445c3-e9a8-5604-8565-8b364d248cbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ19643',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-14',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 170',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ19643%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [auto1.it] INFO: Saving data for YJ19643: {'auction_closing_time': 1774884558.0, 'created_time': 1771706250.851056, 'last_price_update_time': 1774861513.092898}
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YJ19643') HTTP/1.1" 204 0
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_ee477c639ee63fbcabc92a209c1aace3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_ee477c639ee63fbcabc92a209c1aace3.jpg not downloaded yet
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_dcafedf07f93e08e8a9833ebf848d7aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_dcafedf07f93e08e8a9833ebf848d7aa.jpg not downloaded yet
2026-03-30 09:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f382eeee-c2dd-5847-9532-10e06af31747 with identifier: ZC12877
2026-03-30 09:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f382eeee-c2dd-5847-9532-10e06af31747 with scrape type 1
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f382eeee-c2dd-5847-9532-10e06af31747
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2b%252Ff22b332413193673e4359d27cca3d39f%252Fpa%252FZC12877_6f357812c7b8f6860c768a3e7dd0fd7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_6f357812c7b8f6860c768a3e7dd0fd7b.jpg already downloaded
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2b%252Ff22b332413193673e4359d27cca3d39f%252Fpa%252FZC12877_2f5a7ad159226cacec7d9067df6c0b99.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_2f5a7ad159226cacec7d9067df6c0b99.jpg already downloaded
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2b%252Ff22b332413193673e4359d27cca3d39f%252Fpa%252FZC12877_9fb49e1ff6810c81de42c2b4180fe466.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_9fb49e1ff6810c81de42c2b4180fe466.jpg already downloaded
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2b%252Ff22b332413193673e4359d27cca3d39f%252Fpa%252FZC12877_0474c35a9649777e28daf28949f8bc3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_0474c35a9649777e28daf28949f8bc3b.jpg already downloaded
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2b%252Ff22b332413193673e4359d27cca3d39f%252Fpa%252FZC12877_d44ab0872b3765b7faf7a0b0bc207a31.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_d44ab0872b3765b7faf7a0b0bc207a31.jpg already downloaded
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2b%252Ff22b332413193673e4359d27cca3d39f%252Fpa%252FZC12877_fddc2db964cadc0a60f24b75b8689c46.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_fddc2db964cadc0a60f24b75b8689c46.jpg already downloaded
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2b%252Ff22b332413193673e4359d27cca3d39f%252Fpa%252FZC12877_1c8c3fdaa1aff60503a9b7720bd0bd4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_1c8c3fdaa1aff60503a9b7720bd0bd4b.jpg already downloaded
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2b%252Ff22b332413193673e4359d27cca3d39f%252Fpa%252FZC12877_97e2371e05737f4d0c1698b230a152cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_97e2371e05737f4d0c1698b230a152cb.jpg already downloaded
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2b%252Ff22b332413193673e4359d27cca3d39f%252Fpa%252FZC12877_fac346e61e5670f3168fd9a2dc8342d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_fac346e61e5670f3168fd9a2dc8342d6.jpg already downloaded
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2b%252Ff22b332413193673e4359d27cca3d39f%252Fpa%252FZC12877_4a5ff15f025844dc7db9354272885cad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_4a5ff15f025844dc7db9354272885cad.jpg already downloaded
2026-03-30 09:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f382eeee-c2dd-5847-9532-10e06af31747, identifier: ZC12877
2026-03-30 09:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_318b6e2505735e8d9062a330a8229f95.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:13 [auto1.it] INFO: Found listing with ID: FA14531
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA14531%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [auto1.it] INFO: Scrape type for FA14531: 2
2026-03-30 09:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93b70ed2-a668-5798-b7e9-99be55b99e68 with identifier: FA14531
2026-03-30 09:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93b70ed2-a668-5798-b7e9-99be55b99e68 with scrape type 2
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93b70ed2-a668-5798-b7e9-99be55b99e68 with scrape type 2
2026-03-30 09:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 93b70ed2-a668-5798-b7e9-99be55b99e68, identifier: FA14531
2026-03-30 09:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM87758/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f382eeee-c2dd-5847-9532-10e06af31747 with identifier: ZC12877
2026-03-30 09:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f382eeee-c2dd-5847-9532-10e06af31747 with identifier: ZC12877
2026-03-30 09:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f382eeee-c2dd-5847-9532-10e06af31747 with identifier: ZC12877 to the API
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZC12877>
{'auction_title': '',
 'c_o_2_emission_value': 55,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 341,
 'expiration_date': '2026-03-31T15:43:25Z',
 'fuel_type': 'hybrid',
 'id': 'f382eeee-c2dd-5847-9532-10e06af31747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC12877',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 216872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_6f357812c7b8f6860c768a3e7dd0fd7b.jpg',
                'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_2f5a7ad159226cacec7d9067df6c0b99.jpg',
                'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_9fb49e1ff6810c81de42c2b4180fe466.jpg',
                'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_0474c35a9649777e28daf28949f8bc3b.jpg',
                'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_d44ab0872b3765b7faf7a0b0bc207a31.jpg',
                'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_fddc2db964cadc0a60f24b75b8689c46.jpg',
                'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_1c8c3fdaa1aff60503a9b7720bd0bd4b.jpg',
                'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_97e2371e05737f4d0c1698b230a152cb.jpg',
                'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_fac346e61e5670f3168fd9a2dc8342d6.jpg',
                'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_4a5ff15f025844dc7db9354272885cad.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f382eeee-c2dd-5847-9532-10e06af31747/f382eeee-c2dd-5847-9532-10e06af31747_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_6f357812c7b8f6860c768a3e7dd0fd7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f382eeee-c2dd-5847-9532-10e06af31747/f382eeee-c2dd-5847-9532-10e06af31747_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_2f5a7ad159226cacec7d9067df6c0b99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f382eeee-c2dd-5847-9532-10e06af31747/f382eeee-c2dd-5847-9532-10e06af31747_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_9fb49e1ff6810c81de42c2b4180fe466.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f382eeee-c2dd-5847-9532-10e06af31747/f382eeee-c2dd-5847-9532-10e06af31747_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_0474c35a9649777e28daf28949f8bc3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f382eeee-c2dd-5847-9532-10e06af31747/f382eeee-c2dd-5847-9532-10e06af31747_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_d44ab0872b3765b7faf7a0b0bc207a31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f382eeee-c2dd-5847-9532-10e06af31747/f382eeee-c2dd-5847-9532-10e06af31747_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_fddc2db964cadc0a60f24b75b8689c46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f382eeee-c2dd-5847-9532-10e06af31747/f382eeee-c2dd-5847-9532-10e06af31747_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_1c8c3fdaa1aff60503a9b7720bd0bd4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f382eeee-c2dd-5847-9532-10e06af31747/f382eeee-c2dd-5847-9532-10e06af31747_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_97e2371e05737f4d0c1698b230a152cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f382eeee-c2dd-5847-9532-10e06af31747/f382eeee-c2dd-5847-9532-10e06af31747_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_fac346e61e5670f3168fd9a2dc8342d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f382eeee-c2dd-5847-9532-10e06af31747/f382eeee-c2dd-5847-9532-10e06af31747_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2b/f22b332413193673e4359d27cca3d39f/pa/ZC12877_4a5ff15f025844dc7db9354272885cad.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T6 Plug-in Hybrid Inscription Expression AWD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression AWD',
 'year': 2021}
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC12877%27 HTTP/1.1" 200 None
2026-03-30 09:05:14 [auto1.it] INFO: Saving data for ZC12877: {'created_time': 1774861514.300761, 'last_price_update_time': 1774861514.300774, 'auction_closing_time': 1774971805.0}
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZC12877') HTTP/1.1" 204 0
2026-03-30 09:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 93b70ed2-a668-5798-b7e9-99be55b99e68 with identifier: FA14531
2026-03-30 09:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 93b70ed2-a668-5798-b7e9-99be55b99e68 with identifier: FA14531
2026-03-30 09:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 93b70ed2-a668-5798-b7e9-99be55b99e68 with identifier: FA14531 to the API
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:31:31Z',
 'fuel_type': 'diesel',
 'id': '93b70ed2-a668-5798-b7e9-99be55b99e68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA14531',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 255371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-31',
 'seller_name': None,
 'title': 'Nissan Note 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2006}
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA14531%27 HTTP/1.1" 200 None
2026-03-30 09:05:14 [auto1.it] INFO: Saving data for FA14531: {'auction_closing_time': 1774884691.0, 'created_time': 1773136583.508256, 'last_price_update_time': 1774861514.688824}
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FA14531') HTTP/1.1" 204 0
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_b831a6d36e77d35dc18e5491fcf67437.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_b831a6d36e77d35dc18e5491fcf67437.jpg not downloaded yet
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_c5dd9785352766a4b6a1dc6f990fabf4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_c5dd9785352766a4b6a1dc6f990fabf4.jpg not downloaded yet
2026-03-30 09:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_812ae91b7e63e219dff51b59b74e998f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: UK81128
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK81128%27 HTTP/1.1" 200 None
2026-03-30 09:05:14 [auto1.it] INFO: Scrape type for UK81128: 2
2026-03-30 09:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 417c6a13-2202-59e5-b050-cb4e91b62675 with identifier: UK81128
2026-03-30 09:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 417c6a13-2202-59e5-b050-cb4e91b62675 with scrape type 2
2026-03-30 09:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 417c6a13-2202-59e5-b050-cb4e91b62675 with scrape type 2
2026-03-30 09:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 417c6a13-2202-59e5-b050-cb4e91b62675, identifier: UK81128
2026-03-30 09:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dc7dd0>
2026-03-30 09:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_993d660b9b5b6ae241d8600622be3e65.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_993d660b9b5b6ae241d8600622be3e65.jpg saved to cache
2026-03-30 09:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49cbbbd0-3411-5996-b9be-c7b27fd79677
2026-03-30 09:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd8750>
2026-03-30 09:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_42c9d3b202e2d7c02204ea9c35100fb6.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_42c9d3b202e2d7c02204ea9c35100fb6.jpg saved to cache
2026-03-30 09:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1abf3df3-39de-5392-92a4-7f5c25048b80
2026-03-30 09:05:14 [auto1.it] INFO: Channel: 24h | Page: 22 | totalHits: 3302 | hits on page: 40
2026-03-30 09:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d346c63-62b2-5d00-973a-30f62fcbd93f with identifier: ZH14156
2026-03-30 09:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d346c63-62b2-5d00-973a-30f62fcbd93f with scrape type 1
2026-03-30 09:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d346c63-62b2-5d00-973a-30f62fcbd93f
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F90%252F97907ac00fa9f98c042792fde32cb37d%252Fpa%252FZH14156_68f2e5941dbe4e4581f71595f18a7ab8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_68f2e5941dbe4e4581f71595f18a7ab8.jpg already downloaded
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F90%252F97907ac00fa9f98c042792fde32cb37d%252Fpa%252FZH14156_445bfcacbc01474a18b596249b109a5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_445bfcacbc01474a18b596249b109a5a.jpg already downloaded
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F90%252F97907ac00fa9f98c042792fde32cb37d%252Fpa%252FZH14156_1209a420df860d53643c9ce289a4284d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_1209a420df860d53643c9ce289a4284d.jpg already downloaded
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F90%252F97907ac00fa9f98c042792fde32cb37d%252Fpa%252FZH14156_42a7f2467447fa6bac2d17408a51e1b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_42a7f2467447fa6bac2d17408a51e1b0.jpg already downloaded
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F90%252F97907ac00fa9f98c042792fde32cb37d%252Fpa%252FZH14156_708c0f17063ac59b79fa3c109ed185bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_708c0f17063ac59b79fa3c109ed185bf.jpg already downloaded
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F90%252F97907ac00fa9f98c042792fde32cb37d%252Fpa%252FZH14156_56bcd9ae999762e95d314b0e156e9fd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_56bcd9ae999762e95d314b0e156e9fd4.jpg already downloaded
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F90%252F97907ac00fa9f98c042792fde32cb37d%252Fpa%252FZH14156_a6a9bdec1a3f09b4c9284c78fe663ed7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_a6a9bdec1a3f09b4c9284c78fe663ed7.jpg already downloaded
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F90%252F97907ac00fa9f98c042792fde32cb37d%252Fpa%252FZH14156_61fffa8e475014c87e636fb373be43df.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_61fffa8e475014c87e636fb373be43df.jpg already downloaded
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F90%252F97907ac00fa9f98c042792fde32cb37d%252Fpa%252FZH14156_043c8c00c5c9181e149f74c6a89350bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_043c8c00c5c9181e149f74c6a89350bf.jpg already downloaded
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F90%252F97907ac00fa9f98c042792fde32cb37d%252Fpa%252FZH14156_29bf27c965160788e1bfb4abc3c95454.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_29bf27c965160788e1bfb4abc3c95454.jpg already downloaded
2026-03-30 09:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1d346c63-62b2-5d00-973a-30f62fcbd93f, identifier: ZH14156
2026-03-30 09:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0cd57810>
2026-03-30 09:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_1e6039c55ef96fd7c6d8b86651c1cf31.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_1e6039c55ef96fd7c6d8b86651c1cf31.jpg saved to cache
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c16e0be7-5c56-52e8-a902-71a1318b4aed
2026-03-30 09:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_d85a75f5c321573bbe969ed7dffc811f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_15b0438be866f46c917aefbb3d4a5387.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 417c6a13-2202-59e5-b050-cb4e91b62675 with identifier: UK81128
2026-03-30 09:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 417c6a13-2202-59e5-b050-cb4e91b62675 with identifier: UK81128
2026-03-30 09:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 417c6a13-2202-59e5-b050-cb4e91b62675 with identifier: UK81128 to the API
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:45Z',
 'fuel_type': 'diesel',
 'id': '417c6a13-2202-59e5-b050-cb4e91b62675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK81128',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 138981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-25',
 'seller_name': None,
 'title': 'BMW 2er 218d Active Tourer M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2014}
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK81128%27 HTTP/1.1" 200 None
2026-03-30 09:05:15 [auto1.it] INFO: Saving data for UK81128: {'auction_closing_time': 1774884465.0, 'created_time': 1774774834.40203, 'last_price_update_time': 1774861515.780383}
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UK81128') HTTP/1.1" 204 0
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_5794ae95a5ae33df6a172a7e7540f4db.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_5794ae95a5ae33df6a172a7e7540f4db.jpg not downloaded yet
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_4be0465f0396df8aebb79fab15254ac3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_4be0465f0396df8aebb79fab15254ac3.jpg not downloaded yet
2026-03-30 09:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1d346c63-62b2-5d00-973a-30f62fcbd93f with identifier: ZH14156
2026-03-30 09:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1d346c63-62b2-5d00-973a-30f62fcbd93f with identifier: ZH14156
2026-03-30 09:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1d346c63-62b2-5d00-973a-30f62fcbd93f with identifier: ZH14156 to the API
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZH14156>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:49:58Z',
 'fuel_type': 'diesel',
 'id': '1d346c63-62b2-5d00-973a-30f62fcbd93f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH14156',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 377662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_68f2e5941dbe4e4581f71595f18a7ab8.jpg',
                'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_445bfcacbc01474a18b596249b109a5a.jpg',
                'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_1209a420df860d53643c9ce289a4284d.jpg',
                'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_42a7f2467447fa6bac2d17408a51e1b0.jpg',
                'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_708c0f17063ac59b79fa3c109ed185bf.jpg',
                'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_56bcd9ae999762e95d314b0e156e9fd4.jpg',
                'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_a6a9bdec1a3f09b4c9284c78fe663ed7.jpg',
                'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_61fffa8e475014c87e636fb373be43df.jpg',
                'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_043c8c00c5c9181e149f74c6a89350bf.jpg',
                'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_29bf27c965160788e1bfb4abc3c95454.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d346c63-62b2-5d00-973a-30f62fcbd93f/1d346c63-62b2-5d00-973a-30f62fcbd93f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2318882,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_68f2e5941dbe4e4581f71595f18a7ab8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d346c63-62b2-5d00-973a-30f62fcbd93f/1d346c63-62b2-5d00-973a-30f62fcbd93f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2405823,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_445bfcacbc01474a18b596249b109a5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d346c63-62b2-5d00-973a-30f62fcbd93f/1d346c63-62b2-5d00-973a-30f62fcbd93f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2201721,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_1209a420df860d53643c9ce289a4284d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d346c63-62b2-5d00-973a-30f62fcbd93f/1d346c63-62b2-5d00-973a-30f62fcbd93f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2371328,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_42a7f2467447fa6bac2d17408a51e1b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d346c63-62b2-5d00-973a-30f62fcbd93f/1d346c63-62b2-5d00-973a-30f62fcbd93f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2273674,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_708c0f17063ac59b79fa3c109ed185bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d346c63-62b2-5d00-973a-30f62fcbd93f/1d346c63-62b2-5d00-973a-30f62fcbd93f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2385774,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_56bcd9ae999762e95d314b0e156e9fd4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d346c63-62b2-5d00-973a-30f62fcbd93f/1d346c63-62b2-5d00-973a-30f62fcbd93f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2293254,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_a6a9bdec1a3f09b4c9284c78fe663ed7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d346c63-62b2-5d00-973a-30f62fcbd93f/1d346c63-62b2-5d00-973a-30f62fcbd93f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2305367,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_61fffa8e475014c87e636fb373be43df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d346c63-62b2-5d00-973a-30f62fcbd93f/1d346c63-62b2-5d00-973a-30f62fcbd93f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2354954,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_043c8c00c5c9181e149f74c6a89350bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d346c63-62b2-5d00-973a-30f62fcbd93f/1d346c63-62b2-5d00-973a-30f62fcbd93f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2365926,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/90/97907ac00fa9f98c042792fde32cb37d/pa/ZH14156_29bf27c965160788e1bfb4abc3c95454.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2014}
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH14156%27 HTTP/1.1" 200 None
2026-03-30 09:05:16 [auto1.it] INFO: Saving data for ZH14156: {'created_time': 1774861516.62163, 'last_price_update_time': 1774861516.62164, 'auction_closing_time': 1774972198.0}
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH14156') HTTP/1.1" 204 0
2026-03-30 09:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_098181276a98bc3cf417278041642a98.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_3ceab899acc54f3e2585806bf1317382.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: EX63117
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: NP73440
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP73440%27 HTTP/1.1" 200 None
2026-03-30 09:05:16 [auto1.it] INFO: Scrape type for NP73440: 2
2026-03-30 09:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56ff12cd-015f-556a-a71a-6c72da3d7c31 with identifier: NP73440
2026-03-30 09:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56ff12cd-015f-556a-a71a-6c72da3d7c31 with scrape type 2
2026-03-30 09:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56ff12cd-015f-556a-a71a-6c72da3d7c31 with scrape type 2
2026-03-30 09:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 56ff12cd-015f-556a-a71a-6c72da3d7c31, identifier: NP73440
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: HL96914
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: UZ59848
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ59848%27 HTTP/1.1" 200 None
2026-03-30 09:05:16 [auto1.it] INFO: Scrape type for UZ59848: 2
2026-03-30 09:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6faf843-1515-5b2a-8659-7a807dedfa2b with identifier: UZ59848
2026-03-30 09:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6faf843-1515-5b2a-8659-7a807dedfa2b with scrape type 2
2026-03-30 09:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6faf843-1515-5b2a-8659-7a807dedfa2b with scrape type 2
2026-03-30 09:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e6faf843-1515-5b2a-8659-7a807dedfa2b, identifier: UZ59848
2026-03-30 09:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC55039> (referer: https://www.auto1.com/v1/car-details-view/TC55039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e47dd0>
2026-03-30 09:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_318b6e2505735e8d9062a330a8229f95.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_318b6e2505735e8d9062a330a8229f95.jpg saved to cache
2026-03-30 09:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f47752c3-4d30-5ecd-baca-78a158010ea5
2026-03-30 09:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 56ff12cd-015f-556a-a71a-6c72da3d7c31 with identifier: NP73440
2026-03-30 09:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 56ff12cd-015f-556a-a71a-6c72da3d7c31 with identifier: NP73440
2026-03-30 09:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 56ff12cd-015f-556a-a71a-6c72da3d7c31 with identifier: NP73440 to the API
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-30T15:35:58Z',
 'fuel_type': 'diesel',
 'id': '56ff12cd-015f-556a-a71a-6c72da3d7c31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP73440',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Defender',
 'odometer': 116317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-05',
 'seller_name': None,
 'title': 'Land Rover Defender D240 110 S',
 'transmission': 'automatic',
 'trim': '110 S',
 'year': 2020}
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP73440%27 HTTP/1.1" 200 None
2026-03-30 09:05:17 [auto1.it] INFO: Saving data for NP73440: {'auction_closing_time': 1774884958.0, 'created_time': 1774774835.972389, 'last_price_update_time': 1774861517.618477}
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NP73440') HTTP/1.1" 204 0
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_a89859a5f1f7b4ef9153a74578a7901e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_a89859a5f1f7b4ef9153a74578a7901e.jpg not downloaded yet
2026-03-30 09:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e6faf843-1515-5b2a-8659-7a807dedfa2b with identifier: UZ59848
2026-03-30 09:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e6faf843-1515-5b2a-8659-7a807dedfa2b with identifier: UZ59848
2026-03-30 09:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e6faf843-1515-5b2a-8659-7a807dedfa2b with identifier: UZ59848 to the API
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:00:12Z',
 'fuel_type': 'petrol',
 'id': 'e6faf843-1515-5b2a-8659-7a807dedfa2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ59848',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 27488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seller_name': None,
 'title': 'Fiat 500 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ59848%27 HTTP/1.1" 200 None
2026-03-30 09:05:18 [auto1.it] INFO: Saving data for UZ59848: {'auction_closing_time': 1774882812.0, 'created_time': 1774774844.069693, 'last_price_update_time': 1774861518.118195}
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UZ59848') HTTP/1.1" 204 0
2026-03-30 09:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06304b50>
2026-03-30 09:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_812ae91b7e63e219dff51b59b74e998f.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_812ae91b7e63e219dff51b59b74e998f.jpg saved to cache
2026-03-30 09:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1abf3df3-39de-5392-92a4-7f5c25048b80
2026-03-30 09:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_015365954e7ce03974a9cbac270fc949.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_baf17e44c6484e18c3339b6743ca66f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:18 [auto1.it] INFO: Found listing with ID: XY01998
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY01998%27 HTTP/1.1" 200 None
2026-03-30 09:05:18 [auto1.it] INFO: Scrape type for XY01998: 2
2026-03-30 09:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14594c14-96e9-5377-96df-52dff5bef02f with identifier: XY01998
2026-03-30 09:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14594c14-96e9-5377-96df-52dff5bef02f with scrape type 2
2026-03-30 09:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14594c14-96e9-5377-96df-52dff5bef02f with scrape type 2
2026-03-30 09:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 14594c14-96e9-5377-96df-52dff5bef02f, identifier: XY01998
2026-03-30 09:05:18 [auto1.it] INFO: Found listing with ID: MU02206
2026-03-30 09:05:18 [auto1.it] INFO: Found listing with ID: UW33297
2026-03-30 09:05:18 [auto1.it] INFO: Found listing with ID: LH51600
2026-03-30 09:05:18 [auto1.it] INFO: Found listing with ID: CW23550
2026-03-30 09:05:18 [auto1.it] INFO: Found listing with ID: DZ80898
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ80898%27 HTTP/1.1" 200 None
2026-03-30 09:05:18 [auto1.it] INFO: Scrape type for DZ80898: 2
2026-03-30 09:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a72e4d1c-6d78-5309-8c33-7ce8cb85b0d3 with identifier: DZ80898
2026-03-30 09:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72e4d1c-6d78-5309-8c33-7ce8cb85b0d3 with scrape type 2
2026-03-30 09:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a72e4d1c-6d78-5309-8c33-7ce8cb85b0d3 with scrape type 2
2026-03-30 09:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a72e4d1c-6d78-5309-8c33-7ce8cb85b0d3, identifier: DZ80898
2026-03-30 09:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_1426b9320f137ec1f12c579940f87b41.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_d73caba008c94625b85c63c7a12798e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_4e44b4bbb3f1c4cb022d081afcf3860c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 14594c14-96e9-5377-96df-52dff5bef02f with identifier: XY01998
2026-03-30 09:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 14594c14-96e9-5377-96df-52dff5bef02f with identifier: XY01998
2026-03-30 09:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 14594c14-96e9-5377-96df-52dff5bef02f with identifier: XY01998 to the API
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:08:35Z',
 'fuel_type': 'petrol',
 'id': '14594c14-96e9-5377-96df-52dff5bef02f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY01998',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 50742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-04',
 'seller_name': None,
 'title': "Kia cee'd 1.5 TGDI Mild-Hybrid GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2022}
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY01998%27 HTTP/1.1" 200 None
2026-03-30 09:05:18 [auto1.it] INFO: Saving data for XY01998: {'auction_closing_time': 1774883315.0, 'created_time': 1774774838.545471, 'last_price_update_time': 1774861518.783609}
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XY01998') HTTP/1.1" 204 0
2026-03-30 09:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a72e4d1c-6d78-5309-8c33-7ce8cb85b0d3 with identifier: DZ80898
2026-03-30 09:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a72e4d1c-6d78-5309-8c33-7ce8cb85b0d3 with identifier: DZ80898
2026-03-30 09:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a72e4d1c-6d78-5309-8c33-7ce8cb85b0d3 with identifier: DZ80898 to the API
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:45:09Z',
 'fuel_type': 'diesel',
 'id': 'a72e4d1c-6d78-5309-8c33-7ce8cb85b0d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ80898',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 87830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-19',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Super',
 'transmission': 'automatic',
 'trim': 'Super',
 'year': 2018}
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ80898%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [auto1.it] INFO: Saving data for DZ80898: {'auction_closing_time': 1774885509.0, 'created_time': 1774774850.083909, 'last_price_update_time': 1774861519.10833}
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DZ80898') HTTP/1.1" 204 0
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0624bbd0>
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_d85a75f5c321573bbe969ed7dffc811f.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_d85a75f5c321573bbe969ed7dffc811f.jpg saved to cache
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49cbbbd0-3411-5996-b9be-c7b27fd79677
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06118690>
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_15b0438be866f46c917aefbb3d4a5387.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_15b0438be866f46c917aefbb3d4a5387.jpg saved to cache
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1abf3df3-39de-5392-92a4-7f5c25048b80
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cc6150>
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_098181276a98bc3cf417278041642a98.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_098181276a98bc3cf417278041642a98.jpg saved to cache
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49cbbbd0-3411-5996-b9be-c7b27fd79677
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062482d0>
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_3ceab899acc54f3e2585806bf1317382.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_3ceab899acc54f3e2585806bf1317382.jpg saved to cache
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1abf3df3-39de-5392-92a4-7f5c25048b80
2026-03-30 09:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adb3e882-f82a-55b8-b85a-94a8ba040969 with identifier: TC55039
2026-03-30 09:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adb3e882-f82a-55b8-b85a-94a8ba040969 with scrape type 1
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item adb3e882-f82a-55b8-b85a-94a8ba040969
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F85%252F85851cb18262e1f3aa673180e2a04f88%252Fpa%252FTC55039_98ce4629caf830d83488835929dd74db.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_98ce4629caf830d83488835929dd74db.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F85%252F85851cb18262e1f3aa673180e2a04f88%252Fpa%252FTC55039_3185717712ae833912e2bb5a5761545f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_3185717712ae833912e2bb5a5761545f.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F85%252F85851cb18262e1f3aa673180e2a04f88%252Fpa%252FTC55039_569585dde9066092ba87ded2a7541d42.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_569585dde9066092ba87ded2a7541d42.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F85%252F85851cb18262e1f3aa673180e2a04f88%252Fpa%252FTC55039_024ea33b55f1a17dfcef187f4ff48ad9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_024ea33b55f1a17dfcef187f4ff48ad9.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F85%252F85851cb18262e1f3aa673180e2a04f88%252Fpa%252FTC55039_306bed9dfd289c64bf0fe79c30190e05.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_306bed9dfd289c64bf0fe79c30190e05.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F85%252F85851cb18262e1f3aa673180e2a04f88%252Fpa%252FTC55039_ef2dd4f2060f802e59521f81faa91340.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_ef2dd4f2060f802e59521f81faa91340.jpg already downloaded
2026-03-30 09:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: adb3e882-f82a-55b8-b85a-94a8ba040969, identifier: TC55039
2026-03-30 09:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_b9fb6582fa0171929119d8db6003b6fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_dcafedf07f93e08e8a9833ebf848d7aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:19 [auto1.it] INFO: Found listing with ID: PU31383
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU31383%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [auto1.it] INFO: Scrape type for PU31383: 2
2026-03-30 09:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47893a7a-9c29-55d1-b056-5990382044e8 with identifier: PU31383
2026-03-30 09:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47893a7a-9c29-55d1-b056-5990382044e8 with scrape type 2
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47893a7a-9c29-55d1-b056-5990382044e8 with scrape type 2
2026-03-30 09:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47893a7a-9c29-55d1-b056-5990382044e8, identifier: PU31383
2026-03-30 09:05:19 [auto1.it] INFO: Found listing with ID: PK60217
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK60217%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [auto1.it] INFO: Scrape type for PK60217: 2
2026-03-30 09:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4164779-717b-5b3a-95f2-da41fbac1542 with identifier: PK60217
2026-03-30 09:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4164779-717b-5b3a-95f2-da41fbac1542 with scrape type 2
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4164779-717b-5b3a-95f2-da41fbac1542 with scrape type 2
2026-03-30 09:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4164779-717b-5b3a-95f2-da41fbac1542, identifier: PK60217
2026-03-30 09:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: adb3e882-f82a-55b8-b85a-94a8ba040969 with identifier: TC55039
2026-03-30 09:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: adb3e882-f82a-55b8-b85a-94a8ba040969 with identifier: TC55039
2026-03-30 09:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: adb3e882-f82a-55b8-b85a-94a8ba040969 with identifier: TC55039 to the API
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TC55039>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:31:58Z',
 'fuel_type': 'petrol',
 'id': 'adb3e882-f82a-55b8-b85a-94a8ba040969',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC55039',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 79020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_98ce4629caf830d83488835929dd74db.jpg',
                'https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_3185717712ae833912e2bb5a5761545f.jpg',
                'https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_569585dde9066092ba87ded2a7541d42.jpg',
                'https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_024ea33b55f1a17dfcef187f4ff48ad9.jpg',
                'https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_306bed9dfd289c64bf0fe79c30190e05.jpg',
                'https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_ef2dd4f2060f802e59521f81faa91340.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb3e882-f82a-55b8-b85a-94a8ba040969/adb3e882-f82a-55b8-b85a-94a8ba040969_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_98ce4629caf830d83488835929dd74db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb3e882-f82a-55b8-b85a-94a8ba040969/adb3e882-f82a-55b8-b85a-94a8ba040969_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_3185717712ae833912e2bb5a5761545f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb3e882-f82a-55b8-b85a-94a8ba040969/adb3e882-f82a-55b8-b85a-94a8ba040969_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_569585dde9066092ba87ded2a7541d42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb3e882-f82a-55b8-b85a-94a8ba040969/adb3e882-f82a-55b8-b85a-94a8ba040969_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_024ea33b55f1a17dfcef187f4ff48ad9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb3e882-f82a-55b8-b85a-94a8ba040969/adb3e882-f82a-55b8-b85a-94a8ba040969_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_306bed9dfd289c64bf0fe79c30190e05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb3e882-f82a-55b8-b85a-94a8ba040969/adb3e882-f82a-55b8-b85a-94a8ba040969_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/85/85851cb18262e1f3aa673180e2a04f88/pa/TC55039_ef2dd4f2060f802e59521f81faa91340.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-12-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Sport Pack',
 'transmission': 'manual',
 'trim': 'Sport Pack',
 'year': 2007}
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC55039%27 HTTP/1.1" 200 None
2026-03-30 09:05:20 [auto1.it] INFO: Saving data for TC55039: {'created_time': 1774861520.288147, 'last_price_update_time': 1774861520.288162, 'auction_closing_time': 1774971118.0}
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TC55039') HTTP/1.1" 204 0
2026-03-30 09:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_58de5a740555c018a8d14ce633009c49.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47893a7a-9c29-55d1-b056-5990382044e8 with identifier: PU31383
2026-03-30 09:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47893a7a-9c29-55d1-b056-5990382044e8 with identifier: PU31383
2026-03-30 09:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 47893a7a-9c29-55d1-b056-5990382044e8 with identifier: PU31383 to the API
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:47:02Z',
 'fuel_type': 'diesel',
 'id': '47893a7a-9c29-55d1-b056-5990382044e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU31383',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 311957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-28',
 'seller_name': None,
 'title': 'Renault Laguna 1.9 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2002}
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU31383%27 HTTP/1.1" 200 None
2026-03-30 09:05:20 [auto1.it] INFO: Saving data for PU31383: {'auction_closing_time': 1774885622.0, 'created_time': 1773781521.455089, 'last_price_update_time': 1774861520.737225}
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PU31383') HTTP/1.1" 204 0
2026-03-30 09:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4164779-717b-5b3a-95f2-da41fbac1542 with identifier: PK60217
2026-03-30 09:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4164779-717b-5b3a-95f2-da41fbac1542 with identifier: PK60217
2026-03-30 09:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4164779-717b-5b3a-95f2-da41fbac1542 with identifier: PK60217 to the API
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:28:42Z',
 'fuel_type': 'diesel',
 'id': 'a4164779-717b-5b3a-95f2-da41fbac1542',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK60217',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 100901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 M-Jet Limited 4x4',
 'transmission': 'automatic',
 'trim': 'Limited 4x4',
 'year': 2019}
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK60217%27 HTTP/1.1" 200 None
2026-03-30 09:05:21 [auto1.it] INFO: Saving data for PK60217: {'auction_closing_time': 1774884522.0, 'created_time': 1774774850.438515, 'last_price_update_time': 1774861521.113014}
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PK60217') HTTP/1.1" 204 0
2026-03-30 09:05:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e15a10>
2026-03-30 09:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_015365954e7ce03974a9cbac270fc949.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_015365954e7ce03974a9cbac270fc949.jpg saved to cache
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f47752c3-4d30-5ecd-baca-78a158010ea5
2026-03-30 09:05:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062cc590>
2026-03-30 09:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F21%252F6521b675e935ab590b92afb96e8fa6f9%252Fpa%252FSY68388_baf17e44c6484e18c3339b6743ca66f9.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_baf17e44c6484e18c3339b6743ca66f9.jpg saved to cache
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f285b5e-287c-5b36-81f7-13f383e6dcde
2026-03-30 09:05:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f285b5e-287c-5b36-81f7-13f383e6dcde, skipping ID generation
2026-03-30 09:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f285b5e-287c-5b36-81f7-13f383e6dcde with scrape type 1
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f285b5e-287c-5b36-81f7-13f383e6dcde sending to next pipeline
2026-03-30 09:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5f285b5e-287c-5b36-81f7-13f383e6dcde, identifier: SY68388
2026-03-30 09:05:21 [auto1.it] INFO: Found listing with ID: VW55609
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW55609%27 HTTP/1.1" 200 None
2026-03-30 09:05:21 [auto1.it] INFO: Scrape type for VW55609: 2
2026-03-30 09:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fca60308-63ba-5fd3-a0ff-9f8cd6447969 with identifier: VW55609
2026-03-30 09:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fca60308-63ba-5fd3-a0ff-9f8cd6447969 with scrape type 2
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fca60308-63ba-5fd3-a0ff-9f8cd6447969 with scrape type 2
2026-03-30 09:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fca60308-63ba-5fd3-a0ff-9f8cd6447969, identifier: VW55609
2026-03-30 09:05:21 [auto1.it] INFO: Found listing with ID: VL28200
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL28200%27 HTTP/1.1" 200 None
2026-03-30 09:05:21 [auto1.it] INFO: Scrape type for VL28200: 2
2026-03-30 09:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c9dbc76-680d-5466-a1b1-52e92ed9efcd with identifier: VL28200
2026-03-30 09:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c9dbc76-680d-5466-a1b1-52e92ed9efcd with scrape type 2
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c9dbc76-680d-5466-a1b1-52e92ed9efcd with scrape type 2
2026-03-30 09:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c9dbc76-680d-5466-a1b1-52e92ed9efcd, identifier: VL28200
2026-03-30 09:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5f285b5e-287c-5b36-81f7-13f383e6dcde with identifier: SY68388
2026-03-30 09:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5f285b5e-287c-5b36-81f7-13f383e6dcde with identifier: SY68388
2026-03-30 09:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5f285b5e-287c-5b36-81f7-13f383e6dcde with identifier: SY68388 to the API
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_baf17e44c6484e18c3339b6743ca66f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:10:20Z',
 'fuel_type': 'diesel',
 'id': '5f285b5e-287c-5b36-81f7-13f383e6dcde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY68388',
 'listing': 'auction',
 'location': 'IT, Livorno',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 165187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2502115,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_baf17e44c6484e18c3339b6743ca66f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_b9ba5f1b0a9a645e0e2fb5a73b71b5d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412439,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_dc80e3d00d36f1ea695cfc2e4791e11e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2614682,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_e4d580fa08bdbec24f50410952500091.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_eb07c5ae84ba800aa443c005e7208294.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2326483,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_e964915b2dc3f3ced81aebb0b852a87d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421105,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_7fd2c625e279bbded1e516487adaccf3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2365676,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_4e5b57169b1e7d71c61dbde42ca20568.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2373650,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_753d9df1ac095736f9cd40382979c1b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f285b5e-287c-5b36-81f7-13f383e6dcde/5f285b5e-287c-5b36-81f7-13f383e6dcde_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2858312,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/21/6521b675e935ab590b92afb96e8fa6f9/pa/SY68388_b92126f388f813057d9ffae15d97905d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2016}
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY68388%27 HTTP/1.1" 200 None
2026-03-30 09:05:22 [auto1.it] INFO: Saving data for SY68388: {'created_time': 1774861522.218971, 'last_price_update_time': 1774861522.218982, 'auction_closing_time': 1774969820.0}
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SY68388') HTTP/1.1" 204 0
2026-03-30 09:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d06de10>
2026-03-30 09:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_1426b9320f137ec1f12c579940f87b41.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_1426b9320f137ec1f12c579940f87b41.jpg saved to cache
2026-03-30 09:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c16e0be7-5c56-52e8-a902-71a1318b4aed
2026-03-30 09:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f79690>
2026-03-30 09:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_d73caba008c94625b85c63c7a12798e9.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_d73caba008c94625b85c63c7a12798e9.jpg saved to cache
2026-03-30 09:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49cbbbd0-3411-5996-b9be-c7b27fd79677
2026-03-30 09:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0623da50>
2026-03-30 09:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_4e44b4bbb3f1c4cb022d081afcf3860c.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_4e44b4bbb3f1c4cb022d081afcf3860c.jpg saved to cache
2026-03-30 09:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1abf3df3-39de-5392-92a4-7f5c25048b80
2026-03-30 09:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_4be0465f0396df8aebb79fab15254ac3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_c5dd9785352766a4b6a1dc6f990fabf4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fca60308-63ba-5fd3-a0ff-9f8cd6447969 with identifier: VW55609
2026-03-30 09:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fca60308-63ba-5fd3-a0ff-9f8cd6447969 with identifier: VW55609
2026-03-30 09:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fca60308-63ba-5fd3-a0ff-9f8cd6447969 with identifier: VW55609 to the API
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:45:48Z',
 'fuel_type': 'petrol',
 'id': 'fca60308-63ba-5fd3-a0ff-9f8cd6447969',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW55609',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 82183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-24',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 35 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW55609%27 HTTP/1.1" 200 None
2026-03-30 09:05:22 [auto1.it] INFO: Saving data for VW55609: {'auction_closing_time': 1774885548.0, 'created_time': 1774774839.98071, 'last_price_update_time': 1774861522.742848}
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VW55609') HTTP/1.1" 204 0
2026-03-30 09:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c9dbc76-680d-5466-a1b1-52e92ed9efcd with identifier: VL28200
2026-03-30 09:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c9dbc76-680d-5466-a1b1-52e92ed9efcd with identifier: VL28200
2026-03-30 09:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c9dbc76-680d-5466-a1b1-52e92ed9efcd with identifier: VL28200 to the API
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:16:46Z',
 'fuel_type': 'diesel',
 'id': '8c9dbc76-680d-5466-a1b1-52e92ed9efcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL28200',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 99457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueTEC Executive',
 'transmission': 'automatic',
 'trim': 'BlueTEC Executive',
 'year': 2015}
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL28200%27 HTTP/1.1" 200 None
2026-03-30 09:05:23 [auto1.it] INFO: Saving data for VL28200: {'auction_closing_time': 1774883806.0, 'created_time': 1774774849.758443, 'last_price_update_time': 1774861523.079369}
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VL28200') HTTP/1.1" 204 0
2026-03-30 09:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_b831a6d36e77d35dc18e5491fcf67437.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:23 [auto1.it] INFO: Found listing with ID: GT29075
2026-03-30 09:05:23 [auto1.it] INFO: Found listing with ID: HB16965
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB16965%27 HTTP/1.1" 200 None
2026-03-30 09:05:23 [auto1.it] INFO: Scrape type for HB16965: 2
2026-03-30 09:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46a25fbf-e2a2-5206-8f1a-a15cc700407d with identifier: HB16965
2026-03-30 09:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46a25fbf-e2a2-5206-8f1a-a15cc700407d with scrape type 2
2026-03-30 09:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46a25fbf-e2a2-5206-8f1a-a15cc700407d with scrape type 2
2026-03-30 09:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 46a25fbf-e2a2-5206-8f1a-a15cc700407d, identifier: HB16965
2026-03-30 09:05:23 [auto1.it] INFO: Found listing with ID: YV65594
2026-03-30 09:05:23 [auto1.it] INFO: Found listing with ID: UV62618
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV62618%27 HTTP/1.1" 200 None
2026-03-30 09:05:23 [auto1.it] INFO: Scrape type for UV62618: 2
2026-03-30 09:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 535682ac-1124-543e-85d2-da0de09d1eb0 with identifier: UV62618
2026-03-30 09:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 535682ac-1124-543e-85d2-da0de09d1eb0 with scrape type 2
2026-03-30 09:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 535682ac-1124-543e-85d2-da0de09d1eb0 with scrape type 2
2026-03-30 09:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 535682ac-1124-543e-85d2-da0de09d1eb0, identifier: UV62618
2026-03-30 09:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061d7210>
2026-03-30 09:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_b9fb6582fa0171929119d8db6003b6fe.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_b9fb6582fa0171929119d8db6003b6fe.jpg saved to cache
2026-03-30 09:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49cbbbd0-3411-5996-b9be-c7b27fd79677
2026-03-30 09:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061a7d10>
2026-03-30 09:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_dcafedf07f93e08e8a9833ebf848d7aa.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_dcafedf07f93e08e8a9833ebf848d7aa.jpg saved to cache
2026-03-30 09:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1abf3df3-39de-5392-92a4-7f5c25048b80
2026-03-30 09:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061f3810>
2026-03-30 09:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_58de5a740555c018a8d14ce633009c49.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_58de5a740555c018a8d14ce633009c49.jpg saved to cache
2026-03-30 09:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c16e0be7-5c56-52e8-a902-71a1318b4aed
2026-03-30 09:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 46a25fbf-e2a2-5206-8f1a-a15cc700407d with identifier: HB16965
2026-03-30 09:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 46a25fbf-e2a2-5206-8f1a-a15cc700407d with identifier: HB16965
2026-03-30 09:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 46a25fbf-e2a2-5206-8f1a-a15cc700407d with identifier: HB16965 to the API
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:38:08Z',
 'fuel_type': 'diesel',
 'id': '46a25fbf-e2a2-5206-8f1a-a15cc700407d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB16965',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 364083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-17',
 'seller_name': None,
 'title': 'Audi A4 1.9 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2024}
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB16965%27 HTTP/1.1" 200 None
2026-03-30 09:05:23 [auto1.it] INFO: Saving data for HB16965: {'auction_closing_time': 1774885088.0, 'created_time': 1773414095.518759, 'last_price_update_time': 1774861523.822225}
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HB16965') HTTP/1.1" 204 0
2026-03-30 09:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 535682ac-1124-543e-85d2-da0de09d1eb0 with identifier: UV62618
2026-03-30 09:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 535682ac-1124-543e-85d2-da0de09d1eb0 with identifier: UV62618
2026-03-30 09:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 535682ac-1124-543e-85d2-da0de09d1eb0 with identifier: UV62618 to the API
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:17:03Z',
 'fuel_type': 'diesel',
 'id': '535682ac-1124-543e-85d2-da0de09d1eb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV62618',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 274095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-26',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2005}
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV62618%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [auto1.it] INFO: Saving data for UV62618: {'auction_closing_time': 1774883823.0, 'created_time': 1774774856.914828, 'last_price_update_time': 1774861524.111473}
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UV62618') HTTP/1.1" 204 0
2026-03-30 09:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP57623> (referer: https://www.auto1.com/v1/car-details-view/VP57623/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN04356/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:24 [auto1.it] INFO: Found listing with ID: GU77737
2026-03-30 09:05:24 [auto1.it] INFO: Found listing with ID: MR77890
2026-03-30 09:05:24 [auto1.it] INFO: Found listing with ID: YV05743
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV05743%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [auto1.it] INFO: Scrape type for YV05743: 2
2026-03-30 09:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ce9cd6-5f42-53f0-97d1-a966cd3013e9 with identifier: YV05743
2026-03-30 09:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ce9cd6-5f42-53f0-97d1-a966cd3013e9 with scrape type 2
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ce9cd6-5f42-53f0-97d1-a966cd3013e9 with scrape type 2
2026-03-30 09:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 08ce9cd6-5f42-53f0-97d1-a966cd3013e9, identifier: YV05743
2026-03-30 09:05:24 [auto1.it] INFO: Found listing with ID: ME67142
2026-03-30 09:05:24 [auto1.it] INFO: Found listing with ID: EH68061
2026-03-30 09:05:24 [auto1.it] INFO: Found listing with ID: MP71804
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP71804%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [auto1.it] INFO: Scrape type for MP71804: 2
2026-03-30 09:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dd86759-3398-5775-8622-31fe67ff3d34 with identifier: MP71804
2026-03-30 09:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dd86759-3398-5775-8622-31fe67ff3d34 with scrape type 2
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dd86759-3398-5775-8622-31fe67ff3d34 with scrape type 2
2026-03-30 09:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3dd86759-3398-5775-8622-31fe67ff3d34, identifier: MP71804
2026-03-30 09:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061a5a50>
2026-03-30 09:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_4be0465f0396df8aebb79fab15254ac3.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_4be0465f0396df8aebb79fab15254ac3.jpg saved to cache
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1abf3df3-39de-5392-92a4-7f5c25048b80
2026-03-30 09:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f4d350>
2026-03-30 09:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_c5dd9785352766a4b6a1dc6f990fabf4.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_c5dd9785352766a4b6a1dc6f990fabf4.jpg saved to cache
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1abf3df3-39de-5392-92a4-7f5c25048b80
2026-03-30 09:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 08ce9cd6-5f42-53f0-97d1-a966cd3013e9 with identifier: YV05743
2026-03-30 09:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 08ce9cd6-5f42-53f0-97d1-a966cd3013e9 with identifier: YV05743
2026-03-30 09:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 08ce9cd6-5f42-53f0-97d1-a966cd3013e9 with identifier: YV05743 to the API
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:57:46Z',
 'fuel_type': 'petrol',
 'id': '08ce9cd6-5f42-53f0-97d1-a966cd3013e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV05743',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 85661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-25',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2020}
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV05743%27 HTTP/1.1" 200 None
2026-03-30 09:05:25 [auto1.it] INFO: Saving data for YV05743: {'auction_closing_time': 1774886266.0, 'created_time': 1774774843.744375, 'last_price_update_time': 1774861525.00854}
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YV05743') HTTP/1.1" 204 0
2026-03-30 09:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3dd86759-3398-5775-8622-31fe67ff3d34 with identifier: MP71804
2026-03-30 09:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3dd86759-3398-5775-8622-31fe67ff3d34 with identifier: MP71804
2026-03-30 09:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3dd86759-3398-5775-8622-31fe67ff3d34 with identifier: MP71804 to the API
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:24:50Z',
 'fuel_type': 'diesel',
 'id': '3dd86759-3398-5775-8622-31fe67ff3d34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP71804',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 228078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-06',
 'seller_name': None,
 'title': 'Toyota Avensis 2.2 D-4D D-Cat Sol',
 'transmission': 'manual',
 'trim': 'D-Cat Sol',
 'year': 2006}
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP71804%27 HTTP/1.1" 200 None
2026-03-30 09:05:25 [auto1.it] INFO: Saving data for MP71804: {'auction_closing_time': 1774884290.0, 'created_time': 1774645486.732211, 'last_price_update_time': 1774861525.504745}
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MP71804') HTTP/1.1" 204 0
2026-03-30 09:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061ea850>
2026-03-30 09:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_b831a6d36e77d35dc18e5491fcf67437.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_b831a6d36e77d35dc18e5491fcf67437.jpg saved to cache
2026-03-30 09:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49cbbbd0-3411-5996-b9be-c7b27fd79677
2026-03-30 09:05:25 [auto1.it] INFO: Channel: 24h | Page: 23 | totalHits: 3303 | hits on page: 40
2026-03-30 09:05:25 [auto1.it] INFO: Found listing with ID: PF34434
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF34434%27 HTTP/1.1" 200 None
2026-03-30 09:05:25 [auto1.it] INFO: Scrape type for PF34434: 2
2026-03-30 09:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8856cef1-50fe-5a41-967e-61ff47034635 with identifier: PF34434
2026-03-30 09:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8856cef1-50fe-5a41-967e-61ff47034635 with scrape type 2
2026-03-30 09:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8856cef1-50fe-5a41-967e-61ff47034635 with scrape type 2
2026-03-30 09:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8856cef1-50fe-5a41-967e-61ff47034635, identifier: PF34434
2026-03-30 09:05:25 [auto1.it] INFO: Found listing with ID: HG08140
2026-03-30 09:05:25 [auto1.it] INFO: Found listing with ID: EC56092
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC56092%27 HTTP/1.1" 200 None
2026-03-30 09:05:25 [auto1.it] INFO: Scrape type for EC56092: 2
2026-03-30 09:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cac71b01-ec0d-5295-9722-46a4e8d5e55d with identifier: EC56092
2026-03-30 09:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cac71b01-ec0d-5295-9722-46a4e8d5e55d with scrape type 2
2026-03-30 09:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cac71b01-ec0d-5295-9722-46a4e8d5e55d with scrape type 2
2026-03-30 09:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cac71b01-ec0d-5295-9722-46a4e8d5e55d, identifier: EC56092
2026-03-30 09:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_df435559b65db970fe15e67433bfdbf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_a89859a5f1f7b4ef9153a74578a7901e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_c3ffa042b593d929d7749716db87fa4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8856cef1-50fe-5a41-967e-61ff47034635 with identifier: PF34434
2026-03-30 09:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8856cef1-50fe-5a41-967e-61ff47034635 with identifier: PF34434
2026-03-30 09:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8856cef1-50fe-5a41-967e-61ff47034635 with identifier: PF34434 to the API
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:10:06Z',
 'fuel_type': 'diesel',
 'id': '8856cef1-50fe-5a41-967e-61ff47034635',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF34434',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 301608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-31',
 'seller_name': None,
 'title': 'Skoda Octavia 1.9 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2005}
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF34434%27 HTTP/1.1" 200 None
2026-03-30 09:05:26 [auto1.it] INFO: Saving data for PF34434: {'auction_closing_time': 1774883406.0, 'created_time': 1774645541.445098, 'last_price_update_time': 1774861526.19919}
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PF34434') HTTP/1.1" 204 0
2026-03-30 09:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cac71b01-ec0d-5295-9722-46a4e8d5e55d with identifier: EC56092
2026-03-30 09:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cac71b01-ec0d-5295-9722-46a4e8d5e55d with identifier: EC56092
2026-03-30 09:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cac71b01-ec0d-5295-9722-46a4e8d5e55d with identifier: EC56092 to the API
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:12:30Z',
 'fuel_type': 'diesel',
 'id': 'cac71b01-ec0d-5295-9722-46a4e8d5e55d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC56092',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 502405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-31',
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC56092%27 HTTP/1.1" 200 None
2026-03-30 09:05:26 [auto1.it] INFO: Saving data for EC56092: {'auction_closing_time': 1774883550.0, 'created_time': 1774559084.887618, 'last_price_update_time': 1774861526.576289}
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC56092') HTTP/1.1" 204 0
2026-03-30 09:05:26 [auto1.it] INFO: Found listing with ID: AV53481
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV53481%27 HTTP/1.1" 200 None
2026-03-30 09:05:26 [auto1.it] INFO: Scrape type for AV53481: 2
2026-03-30 09:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5f5b743-79ad-52de-91fc-e01ee0590a93 with identifier: AV53481
2026-03-30 09:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5f5b743-79ad-52de-91fc-e01ee0590a93 with scrape type 2
2026-03-30 09:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5f5b743-79ad-52de-91fc-e01ee0590a93 with scrape type 2
2026-03-30 09:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5f5b743-79ad-52de-91fc-e01ee0590a93, identifier: AV53481
2026-03-30 09:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e338fc77-6cf7-590d-b9fd-095d73f56551 with identifier: VP57623
2026-03-30 09:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e338fc77-6cf7-590d-b9fd-095d73f56551 with scrape type 1
2026-03-30 09:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e338fc77-6cf7-590d-b9fd-095d73f56551
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_dfe941985fc7098eb54772bb2ea58443.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_dfe941985fc7098eb54772bb2ea58443.jpg not downloaded yet
2026-03-30 09:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_ee477c639ee63fbcabc92a209c1aace3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_5794ae95a5ae33df6a172a7e7540f4db.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_35ca8965bedea14707d770d199e4a903.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_7940d4dacbbdd258c7932780f72a8a52.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_72053bbdf51805d3ccd906ec5207d2c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:26 [auto1.it] INFO: Found listing with ID: WC74031
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC74031%27 HTTP/1.1" 200 None
2026-03-30 09:05:26 [auto1.it] INFO: Scrape type for WC74031: 2
2026-03-30 09:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77a4046a-2d93-5978-9052-50eef4d2a2f6 with identifier: WC74031
2026-03-30 09:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77a4046a-2d93-5978-9052-50eef4d2a2f6 with scrape type 2
2026-03-30 09:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77a4046a-2d93-5978-9052-50eef4d2a2f6 with scrape type 2
2026-03-30 09:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 77a4046a-2d93-5978-9052-50eef4d2a2f6, identifier: WC74031
2026-03-30 09:05:26 [auto1.it] INFO: Found listing with ID: UL24997
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL24997%27 HTTP/1.1" 200 None
2026-03-30 09:05:26 [auto1.it] INFO: Scrape type for UL24997: 2
2026-03-30 09:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1d20f9c-027a-5b1e-85de-f997c11164a5 with identifier: UL24997
2026-03-30 09:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1d20f9c-027a-5b1e-85de-f997c11164a5 with scrape type 2
2026-03-30 09:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1d20f9c-027a-5b1e-85de-f997c11164a5 with scrape type 2
2026-03-30 09:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e1d20f9c-027a-5b1e-85de-f997c11164a5, identifier: UL24997
2026-03-30 09:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5f5b743-79ad-52de-91fc-e01ee0590a93 with identifier: AV53481
2026-03-30 09:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5f5b743-79ad-52de-91fc-e01ee0590a93 with identifier: AV53481
2026-03-30 09:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5f5b743-79ad-52de-91fc-e01ee0590a93 with identifier: AV53481 to the API
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:01:06Z',
 'fuel_type': 'diesel',
 'id': 'a5f5b743-79ad-52de-91fc-e01ee0590a93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV53481',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Freelander',
 'odometer': 307952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-11-04',
 'seller_name': None,
 'title': 'Land Rover Freelander 2.0 Turbodiesel Di Hardback',
 'transmission': 'manual',
 'trim': 'Di Hardback',
 'year': 1998}
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV53481%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [auto1.it] INFO: Saving data for AV53481: {'auction_closing_time': 1774882866.0, 'created_time': 1774645465.881186, 'last_price_update_time': 1774861527.37952}
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AV53481') HTTP/1.1" 204 0
2026-03-30 09:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 77a4046a-2d93-5978-9052-50eef4d2a2f6 with identifier: WC74031
2026-03-30 09:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 77a4046a-2d93-5978-9052-50eef4d2a2f6 with identifier: WC74031
2026-03-30 09:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 77a4046a-2d93-5978-9052-50eef4d2a2f6 with identifier: WC74031 to the API
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-30T15:54:09Z',
 'fuel_type': 'petrol',
 'id': '77a4046a-2d93-5978-9052-50eef4d2a2f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC74031',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 84018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-05',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2004}
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC74031%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [auto1.it] INFO: Saving data for WC74031: {'auction_closing_time': 1774886049.0, 'created_time': 1774645695.524727, 'last_price_update_time': 1774861527.759308}
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WC74031') HTTP/1.1" 204 0
2026-03-30 09:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e1d20f9c-027a-5b1e-85de-f997c11164a5 with identifier: UL24997
2026-03-30 09:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e1d20f9c-027a-5b1e-85de-f997c11164a5 with identifier: UL24997
2026-03-30 09:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e1d20f9c-027a-5b1e-85de-f997c11164a5 with identifier: UL24997 to the API
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:17:50Z',
 'fuel_type': 'petrol',
 'id': 'e1d20f9c-027a-5b1e-85de-f997c11164a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL24997',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan',
 'odometer': 138882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-29',
 'seller_name': None,
 'title': 'Dacia Logan 1.4 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2006}
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL24997%27 HTTP/1.1" 200 None
2026-03-30 09:05:28 [auto1.it] INFO: Saving data for UL24997: {'auction_closing_time': 1774883870.0, 'created_time': 1774559023.450721, 'last_price_update_time': 1774861528.096393}
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UL24997') HTTP/1.1" 204 0
2026-03-30 09:05:28 [auto1.it] INFO: Found listing with ID: PF95783
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF95783%27 HTTP/1.1" 200 None
2026-03-30 09:05:28 [auto1.it] INFO: Scrape type for PF95783: 2
2026-03-30 09:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b243537e-c668-5cb2-8321-4c08a4173a9c with identifier: PF95783
2026-03-30 09:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b243537e-c668-5cb2-8321-4c08a4173a9c with scrape type 2
2026-03-30 09:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b243537e-c668-5cb2-8321-4c08a4173a9c with scrape type 2
2026-03-30 09:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b243537e-c668-5cb2-8321-4c08a4173a9c, identifier: PF95783
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_c44ebbdf789f65defe6d932ca4cbb47c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_c44ebbdf789f65defe6d932ca4cbb47c.jpg not downloaded yet
2026-03-30 09:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA94787> (referer: https://www.auto1.com/v1/car-details-view/WA94787/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:28 [auto1.it] INFO: Found listing with ID: JX88072
2026-03-30 09:05:28 [auto1.it] INFO: Found listing with ID: RX56981
2026-03-30 09:05:28 [auto1.it] INFO: Found listing with ID: GK78274
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK78274%27 HTTP/1.1" 200 None
2026-03-30 09:05:28 [auto1.it] INFO: Scrape type for GK78274: 2
2026-03-30 09:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d81ceb7d-c035-5b4c-8816-50cb4facd062 with identifier: GK78274
2026-03-30 09:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d81ceb7d-c035-5b4c-8816-50cb4facd062 with scrape type 2
2026-03-30 09:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d81ceb7d-c035-5b4c-8816-50cb4facd062 with scrape type 2
2026-03-30 09:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d81ceb7d-c035-5b4c-8816-50cb4facd062, identifier: GK78274
2026-03-30 09:05:28 [auto1.it] INFO: Found listing with ID: DF56056
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF56056%27 HTTP/1.1" 200 None
2026-03-30 09:05:28 [auto1.it] INFO: Scrape type for DF56056: 2
2026-03-30 09:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0c8ddf1-bb2b-5905-be93-181bd7bb0fc7 with identifier: DF56056
2026-03-30 09:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0c8ddf1-bb2b-5905-be93-181bd7bb0fc7 with scrape type 2
2026-03-30 09:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0c8ddf1-bb2b-5905-be93-181bd7bb0fc7 with scrape type 2
2026-03-30 09:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b0c8ddf1-bb2b-5905-be93-181bd7bb0fc7, identifier: DF56056
2026-03-30 09:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b243537e-c668-5cb2-8321-4c08a4173a9c with identifier: PF95783
2026-03-30 09:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b243537e-c668-5cb2-8321-4c08a4173a9c with identifier: PF95783
2026-03-30 09:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b243537e-c668-5cb2-8321-4c08a4173a9c with identifier: PF95783 to the API
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:01:12Z',
 'fuel_type': 'petrol',
 'id': 'b243537e-c668-5cb2-8321-4c08a4173a9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF95783',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 81520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-13',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Mirror',
 'transmission': 'manual',
 'trim': 'Mirror',
 'year': 2020}
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF95783%27 HTTP/1.1" 200 None
2026-03-30 09:05:28 [auto1.it] INFO: Saving data for PF95783: {'auction_closing_time': 1774882872.0, 'created_time': 1771445163.967934, 'last_price_update_time': 1774861528.804357}
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PF95783') HTTP/1.1" 204 0
2026-03-30 09:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_ba502055f5e684ab3bec3b93f879e580.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_b4bafed002b7f56cde419b49ce740722.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d81ceb7d-c035-5b4c-8816-50cb4facd062 with identifier: GK78274
2026-03-30 09:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d81ceb7d-c035-5b4c-8816-50cb4facd062 with identifier: GK78274
2026-03-30 09:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d81ceb7d-c035-5b4c-8816-50cb4facd062 with identifier: GK78274 to the API
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:03:33Z',
 'fuel_type': 'diesel',
 'id': 'd81ceb7d-c035-5b4c-8816-50cb4facd062',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK78274',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 134970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-24',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK78274%27 HTTP/1.1" 200 None
2026-03-30 09:05:29 [auto1.it] INFO: Saving data for GK78274: {'auction_closing_time': 1774883013.0, 'created_time': 1774774838.060735, 'last_price_update_time': 1774861529.362337}
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GK78274') HTTP/1.1" 204 0
2026-03-30 09:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b0c8ddf1-bb2b-5905-be93-181bd7bb0fc7 with identifier: DF56056
2026-03-30 09:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b0c8ddf1-bb2b-5905-be93-181bd7bb0fc7 with identifier: DF56056
2026-03-30 09:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b0c8ddf1-bb2b-5905-be93-181bd7bb0fc7 with identifier: DF56056 to the API
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:19:35Z',
 'fuel_type': 'petrol',
 'id': 'b0c8ddf1-bb2b-5905-be93-181bd7bb0fc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF56056',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 291013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-05',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF56056%27 HTTP/1.1" 200 None
2026-03-30 09:05:29 [auto1.it] INFO: Saving data for DF56056: {'auction_closing_time': 1774883975.0, 'created_time': 1773749375.999497, 'last_price_update_time': 1774861529.687552}
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DF56056') HTTP/1.1" 204 0
2026-03-30 09:05:29 [auto1.it] INFO: Found listing with ID: AB57400
2026-03-30 09:05:29 [auto1.it] INFO: Found listing with ID: GJ41533
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ41533%27 HTTP/1.1" 200 None
2026-03-30 09:05:29 [auto1.it] INFO: Scrape type for GJ41533: 2
2026-03-30 09:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f997807-8738-595d-9662-33d6fb337e7f with identifier: GJ41533
2026-03-30 09:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f997807-8738-595d-9662-33d6fb337e7f with scrape type 2
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f997807-8738-595d-9662-33d6fb337e7f with scrape type 2
2026-03-30 09:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5f997807-8738-595d-9662-33d6fb337e7f, identifier: GJ41533
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_7c378b19bb874bf2803fc22446be08ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_7c378b19bb874bf2803fc22446be08ad.jpg not downloaded yet
2026-03-30 09:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06111010>
2026-03-30 09:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_df435559b65db970fe15e67433bfdbf6.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_df435559b65db970fe15e67433bfdbf6.jpg saved to cache
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1abf3df3-39de-5392-92a4-7f5c25048b80
2026-03-30 09:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06243e50>
2026-03-30 09:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fec%252F8aec2f7c1c93d52ffa431fae294c0eaf%252Fpa%252FGB15509_a89859a5f1f7b4ef9153a74578a7901e.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_a89859a5f1f7b4ef9153a74578a7901e.jpg saved to cache
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1abf3df3-39de-5392-92a4-7f5c25048b80
2026-03-30 09:05:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1abf3df3-39de-5392-92a4-7f5c25048b80, skipping ID generation
2026-03-30 09:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1abf3df3-39de-5392-92a4-7f5c25048b80 with scrape type 1
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1abf3df3-39de-5392-92a4-7f5c25048b80 sending to next pipeline
2026-03-30 09:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1abf3df3-39de-5392-92a4-7f5c25048b80, identifier: GB15509
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0617ef50>
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_c3ffa042b593d929d7749716db87fa4c.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_c3ffa042b593d929d7749716db87fa4c.jpg saved to cache
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c16e0be7-5c56-52e8-a902-71a1318b4aed
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063e0290>
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_ee477c639ee63fbcabc92a209c1aace3.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_ee477c639ee63fbcabc92a209c1aace3.jpg saved to cache
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49cbbbd0-3411-5996-b9be-c7b27fd79677
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0617d6d0>
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_5794ae95a5ae33df6a172a7e7540f4db.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_5794ae95a5ae33df6a172a7e7540f4db.jpg saved to cache
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49cbbbd0-3411-5996-b9be-c7b27fd79677
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e7dd10>
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F13%252Fe21375f4404a3562d9e837bae6f9c683%252Fpa%252FTV97878_35ca8965bedea14707d770d199e4a903.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_35ca8965bedea14707d770d199e4a903.jpg saved to cache
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49cbbbd0-3411-5996-b9be-c7b27fd79677
2026-03-30 09:05:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49cbbbd0-3411-5996-b9be-c7b27fd79677, skipping ID generation
2026-03-30 09:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49cbbbd0-3411-5996-b9be-c7b27fd79677 with scrape type 1
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49cbbbd0-3411-5996-b9be-c7b27fd79677 sending to next pipeline
2026-03-30 09:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49cbbbd0-3411-5996-b9be-c7b27fd79677, identifier: TV97878
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061f2410>
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_7940d4dacbbdd258c7932780f72a8a52.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_7940d4dacbbdd258c7932780f72a8a52.jpg saved to cache
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c16e0be7-5c56-52e8-a902-71a1318b4aed
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063e3750>
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_72053bbdf51805d3ccd906ec5207d2c4.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_72053bbdf51805d3ccd906ec5207d2c4.jpg saved to cache
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c16e0be7-5c56-52e8-a902-71a1318b4aed
2026-03-30 09:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_688b3bbd71f5d340b3352eeebdd93b6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:30 [auto1.it] INFO: Found listing with ID: NB92665
2026-03-30 09:05:30 [auto1.it] INFO: Found listing with ID: CR61657
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR61657%27 HTTP/1.1" 200 None
2026-03-30 09:05:30 [auto1.it] INFO: Scrape type for CR61657: 2
2026-03-30 09:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcde5af0-7429-591e-9f99-6e74af07933a with identifier: CR61657
2026-03-30 09:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcde5af0-7429-591e-9f99-6e74af07933a with scrape type 2
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcde5af0-7429-591e-9f99-6e74af07933a with scrape type 2
2026-03-30 09:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fcde5af0-7429-591e-9f99-6e74af07933a, identifier: CR61657
2026-03-30 09:05:30 [auto1.it] INFO: Found listing with ID: BA50531
2026-03-30 09:05:30 [auto1.it] INFO: Found listing with ID: PV65475
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV65475%27 HTTP/1.1" 200 None
2026-03-30 09:05:30 [auto1.it] INFO: Scrape type for PV65475: 2
2026-03-30 09:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cbaef67-83b1-593b-b23c-2d1237443df3 with identifier: PV65475
2026-03-30 09:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cbaef67-83b1-593b-b23c-2d1237443df3 with scrape type 2
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cbaef67-83b1-593b-b23c-2d1237443df3 with scrape type 2
2026-03-30 09:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5cbaef67-83b1-593b-b23c-2d1237443df3, identifier: PV65475
2026-03-30 09:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5f997807-8738-595d-9662-33d6fb337e7f with identifier: GJ41533
2026-03-30 09:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5f997807-8738-595d-9662-33d6fb337e7f with identifier: GJ41533
2026-03-30 09:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5f997807-8738-595d-9662-33d6fb337e7f with identifier: GJ41533 to the API
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:14:23Z',
 'fuel_type': 'petrol',
 'id': '5f997807-8738-595d-9662-33d6fb337e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ41533',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'FR-V',
 'odometer': 226779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-20',
 'seller_name': None,
 'title': 'Honda FR-V 1.7 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2005}
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ41533%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [auto1.it] INFO: Saving data for GJ41533: {'auction_closing_time': 1774883663.0, 'created_time': 1774645552.23575, 'last_price_update_time': 1774861531.081607}
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GJ41533') HTTP/1.1" 204 0
2026-03-30 09:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1abf3df3-39de-5392-92a4-7f5c25048b80 with identifier: GB15509
2026-03-30 09:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1abf3df3-39de-5392-92a4-7f5c25048b80 with identifier: GB15509
2026-03-30 09:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1abf3df3-39de-5392-92a4-7f5c25048b80 with identifier: GB15509 to the API
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_a89859a5f1f7b4ef9153a74578a7901e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:23:09Z',
 'fuel_type': 'diesel',
 'id': '1abf3df3-39de-5392-92a4-7f5c25048b80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB15509',
 'listing': 'auction',
 'location': 'IT, Teramo',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 123945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_df435559b65db970fe15e67433bfdbf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_4e44b4bbb3f1c4cb022d081afcf3860c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_42c9d3b202e2d7c02204ea9c35100fb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_15b0438be866f46c917aefbb3d4a5387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_812ae91b7e63e219dff51b59b74e998f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_3ceab899acc54f3e2585806bf1317382.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_dcafedf07f93e08e8a9833ebf848d7aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_c5dd9785352766a4b6a1dc6f990fabf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_4be0465f0396df8aebb79fab15254ac3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1abf3df3-39de-5392-92a4-7f5c25048b80/1abf3df3-39de-5392-92a4-7f5c25048b80_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ec/8aec2f7c1c93d52ffa431fae294c0eaf/pa/GB15509_a89859a5f1f7b4ef9153a74578a7901e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2018}
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB15509%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [auto1.it] INFO: Saving data for GB15509: {'created_time': 1774861531.877242, 'last_price_update_time': 1774861531.877255, 'auction_closing_time': 1774970589.0}
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GB15509') HTTP/1.1" 204 0
2026-03-30 09:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49cbbbd0-3411-5996-b9be-c7b27fd79677 with identifier: TV97878
2026-03-30 09:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49cbbbd0-3411-5996-b9be-c7b27fd79677 with identifier: TV97878
2026-03-30 09:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49cbbbd0-3411-5996-b9be-c7b27fd79677 with identifier: TV97878 to the API
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_35ca8965bedea14707d770d199e4a903.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:52:25Z',
 'fuel_type': 'diesel',
 'id': '49cbbbd0-3411-5996-b9be-c7b27fd79677',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV97878',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 199303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_51433d691b04f674fe587f6d487bb5d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_35ca8965bedea14707d770d199e4a903.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_b9fb6582fa0171929119d8db6003b6fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_993d660b9b5b6ae241d8600622be3e65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_098181276a98bc3cf417278041642a98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_d85a75f5c321573bbe969ed7dffc811f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_d73caba008c94625b85c63c7a12798e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 149151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_ee477c639ee63fbcabc92a209c1aace3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_b831a6d36e77d35dc18e5491fcf67437.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49cbbbd0-3411-5996-b9be-c7b27fd79677/49cbbbd0-3411-5996-b9be-c7b27fd79677_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/13/e21375f4404a3562d9e837bae6f9c683/pa/TV97878_5794ae95a5ae33df6a172a7e7540f4db.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 Allroad 40 TDI Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV97878%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [auto1.it] INFO: Saving data for TV97878: {'created_time': 1774861532.31341, 'last_price_update_time': 1774861532.313422, 'auction_closing_time': 1774972345.0}
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TV97878') HTTP/1.1" 204 0
2026-03-30 09:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fcde5af0-7429-591e-9f99-6e74af07933a with identifier: CR61657
2026-03-30 09:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fcde5af0-7429-591e-9f99-6e74af07933a with identifier: CR61657
2026-03-30 09:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fcde5af0-7429-591e-9f99-6e74af07933a with identifier: CR61657 to the API
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 111,
 'expiration_date': '2026-03-30T15:11:59Z',
 'fuel_type': 'petrol',
 'id': 'fcde5af0-7429-591e-9f99-6e74af07933a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR61657',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 138016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-18',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.0 BoosterJet Cool 4x4',
 'transmission': 'manual',
 'trim': 'Cool 4x4',
 'year': 2019}
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR61657%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [auto1.it] INFO: Saving data for CR61657: {'auction_closing_time': 1774883519.0, 'created_time': 1774774843.424208, 'last_price_update_time': 1774861532.632378}
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CR61657') HTTP/1.1" 204 0
2026-03-30 09:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5cbaef67-83b1-593b-b23c-2d1237443df3 with identifier: PV65475
2026-03-30 09:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5cbaef67-83b1-593b-b23c-2d1237443df3 with identifier: PV65475
2026-03-30 09:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5cbaef67-83b1-593b-b23c-2d1237443df3 with identifier: PV65475 to the API
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:54:54Z',
 'fuel_type': 'diesel',
 'id': '5cbaef67-83b1-593b-b23c-2d1237443df3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV65475',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 95425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-18',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.5 Blue-HDi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2020}
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV65475%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [auto1.it] INFO: Saving data for PV65475: {'auction_closing_time': 1774886094.0, 'created_time': 1774774856.267304, 'last_price_update_time': 1774861532.952691}
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PV65475') HTTP/1.1" 204 0
2026-03-30 09:05:32 [auto1.it] INFO: Found listing with ID: VX65874
2026-03-30 09:05:32 [auto1.it] INFO: Found listing with ID: KC78706
2026-03-30 09:05:32 [auto1.it] INFO: Found listing with ID: EU94181
2026-03-30 09:05:32 [auto1.it] INFO: Found listing with ID: BJ67581
2026-03-30 09:05:32 [auto1.it] INFO: Found listing with ID: AL96330
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL96330%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [auto1.it] INFO: Scrape type for AL96330: 2
2026-03-30 09:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53d123a4-824f-5eed-bcb7-af5f8a2ee07f with identifier: AL96330
2026-03-30 09:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53d123a4-824f-5eed-bcb7-af5f8a2ee07f with scrape type 2
2026-03-30 09:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53d123a4-824f-5eed-bcb7-af5f8a2ee07f with scrape type 2
2026-03-30 09:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 53d123a4-824f-5eed-bcb7-af5f8a2ee07f, identifier: AL96330
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_ef0b916bdc5582d4dd4c4a715be19c21.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_ef0b916bdc5582d4dd4c4a715be19c21.jpg not downloaded yet
2026-03-30 09:05:33 [auto1.it] INFO: Found listing with ID: RU81882
2026-03-30 09:05:33 [auto1.it] INFO: Found listing with ID: NR76329
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR76329%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [auto1.it] INFO: Scrape type for NR76329: 2
2026-03-30 09:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5363988f-fe24-5e3f-b0ed-0fbf776a49d5 with identifier: NR76329
2026-03-30 09:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5363988f-fe24-5e3f-b0ed-0fbf776a49d5 with scrape type 2
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5363988f-fe24-5e3f-b0ed-0fbf776a49d5 with scrape type 2
2026-03-30 09:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5363988f-fe24-5e3f-b0ed-0fbf776a49d5, identifier: NR76329
2026-03-30 09:05:33 [auto1.it] INFO: Found listing with ID: RG96871
2026-03-30 09:05:33 [auto1.it] INFO: Found listing with ID: SJ73545
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ73545%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [auto1.it] INFO: Scrape type for SJ73545: 2
2026-03-30 09:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09eb3150-de07-504c-ab40-7a8ae966b67b with identifier: SJ73545
2026-03-30 09:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09eb3150-de07-504c-ab40-7a8ae966b67b with scrape type 2
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09eb3150-de07-504c-ab40-7a8ae966b67b with scrape type 2
2026-03-30 09:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 09eb3150-de07-504c-ab40-7a8ae966b67b, identifier: SJ73545
2026-03-30 09:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 53d123a4-824f-5eed-bcb7-af5f8a2ee07f with identifier: AL96330
2026-03-30 09:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 53d123a4-824f-5eed-bcb7-af5f8a2ee07f with identifier: AL96330
2026-03-30 09:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 53d123a4-824f-5eed-bcb7-af5f8a2ee07f with identifier: AL96330 to the API
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:32:54Z',
 'fuel_type': 'petrol',
 'id': '53d123a4-824f-5eed-bcb7-af5f8a2ee07f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL96330',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 85930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2021}
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL96330%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [auto1.it] INFO: Saving data for AL96330: {'auction_closing_time': 1774884774.0, 'created_time': 1773694963.611585, 'last_price_update_time': 1774861533.718455}
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL96330') HTTP/1.1" 204 0
2026-03-30 09:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfc4c271-1079-595c-b14d-8d12615cbfa6 with identifier: WA94787
2026-03-30 09:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfc4c271-1079-595c-b14d-8d12615cbfa6 with scrape type 1
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dfc4c271-1079-595c-b14d-8d12615cbfa6
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe1%252Ff1e1b8352bce00f8c8426af6b825e6be%252Fpa%252FWA94787_20397d5b766a34c34e60c3d7444357fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_20397d5b766a34c34e60c3d7444357fc.jpg already downloaded
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe1%252Ff1e1b8352bce00f8c8426af6b825e6be%252Fpa%252FWA94787_3cc58c0dcff0b15bc543203c0119c446.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_3cc58c0dcff0b15bc543203c0119c446.jpg already downloaded
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe1%252Ff1e1b8352bce00f8c8426af6b825e6be%252Fpa%252FWA94787_80f4b30a548d850c57bef842e673bae8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_80f4b30a548d850c57bef842e673bae8.jpg already downloaded
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe1%252Ff1e1b8352bce00f8c8426af6b825e6be%252Fpa%252FWA94787_896f050229d208e693598558d178ec8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_896f050229d208e693598558d178ec8b.jpg already downloaded
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe1%252Ff1e1b8352bce00f8c8426af6b825e6be%252Fpa%252FWA94787_aa8823abbca26ecfbc8c4bd0c9ca5962.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_aa8823abbca26ecfbc8c4bd0c9ca5962.jpg already downloaded
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe1%252Ff1e1b8352bce00f8c8426af6b825e6be%252Fpa%252FWA94787_4244d52e88894c24050ba6221238a79a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_4244d52e88894c24050ba6221238a79a.jpg already downloaded
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe1%252Ff1e1b8352bce00f8c8426af6b825e6be%252Fpa%252FWA94787_dbe69ec602f9d35e15c4230b2a0235fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_dbe69ec602f9d35e15c4230b2a0235fc.jpg already downloaded
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe1%252Ff1e1b8352bce00f8c8426af6b825e6be%252Fpa%252FWA94787_07962fea5fb13a4c1aaddef5c70d174a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_07962fea5fb13a4c1aaddef5c70d174a.jpg already downloaded
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe1%252Ff1e1b8352bce00f8c8426af6b825e6be%252Fpa%252FWA94787_dbde69b57b79f8208113ff36d2d235b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_dbde69b57b79f8208113ff36d2d235b8.jpg already downloaded
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe1%252Ff1e1b8352bce00f8c8426af6b825e6be%252Fpa%252FWA94787_48ecf68418ec5bbd7e966b32c719a805.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_48ecf68418ec5bbd7e966b32c719a805.jpg already downloaded
2026-03-30 09:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dfc4c271-1079-595c-b14d-8d12615cbfa6, identifier: WA94787
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e9f3d0>
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F2c%252F2d2c839fa69b2750385672b29328bf20%252Fpa%252FGA22711_ba502055f5e684ab3bec3b93f879e580.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_ba502055f5e684ab3bec3b93f879e580.jpg saved to cache
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f23c2758-3cf7-594f-a099-9521d3244bb4
2026-03-30 09:05:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f23c2758-3cf7-594f-a099-9521d3244bb4, skipping ID generation
2026-03-30 09:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23c2758-3cf7-594f-a099-9521d3244bb4 with scrape type 1
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f23c2758-3cf7-594f-a099-9521d3244bb4 sending to next pipeline
2026-03-30 09:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f23c2758-3cf7-594f-a099-9521d3244bb4, identifier: GA22711
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06363550>
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc7%252Fc2c7b6fcb7e64a8465f3e618f65ca96e%252Fpa%252FLE83570_b4bafed002b7f56cde419b49ce740722.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_b4bafed002b7f56cde419b49ce740722.jpg saved to cache
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f47752c3-4d30-5ecd-baca-78a158010ea5
2026-03-30 09:05:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f47752c3-4d30-5ecd-baca-78a158010ea5, skipping ID generation
2026-03-30 09:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f47752c3-4d30-5ecd-baca-78a158010ea5 with scrape type 1
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f47752c3-4d30-5ecd-baca-78a158010ea5 sending to next pipeline
2026-03-30 09:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f47752c3-4d30-5ecd-baca-78a158010ea5, identifier: LE83570
2026-03-30 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_dfe941985fc7098eb54772bb2ea58443.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_c44ebbdf789f65defe6d932ca4cbb47c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5363988f-fe24-5e3f-b0ed-0fbf776a49d5 with identifier: NR76329
2026-03-30 09:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5363988f-fe24-5e3f-b0ed-0fbf776a49d5 with identifier: NR76329
2026-03-30 09:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5363988f-fe24-5e3f-b0ed-0fbf776a49d5 with identifier: NR76329 to the API
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:46:37Z',
 'fuel_type': 'petrol',
 'id': '5363988f-fe24-5e3f-b0ed-0fbf776a49d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR76329',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 378901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-08',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR76329%27 HTTP/1.1" 200 None
2026-03-30 09:05:34 [auto1.it] INFO: Saving data for NR76329: {'auction_closing_time': 1774885597.0, 'created_time': 1773489717.282676, 'last_price_update_time': 1774861534.750481}
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR76329') HTTP/1.1" 204 0
2026-03-30 09:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 09eb3150-de07-504c-ab40-7a8ae966b67b with identifier: SJ73545
2026-03-30 09:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 09eb3150-de07-504c-ab40-7a8ae966b67b with identifier: SJ73545
2026-03-30 09:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 09eb3150-de07-504c-ab40-7a8ae966b67b with identifier: SJ73545 to the API
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:46:45Z',
 'fuel_type': 'diesel',
 'id': '09eb3150-de07-504c-ab40-7a8ae966b67b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ73545',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 134464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-28',
 'seller_name': None,
 'title': 'BMW 4er 420d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ73545%27 HTTP/1.1" 200 None
2026-03-30 09:05:35 [auto1.it] INFO: Saving data for SJ73545: {'auction_closing_time': 1774885605.0, 'created_time': 1773694963.243869, 'last_price_update_time': 1774861535.131654}
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SJ73545') HTTP/1.1" 204 0
2026-03-30 09:05:35 [auto1.it] INFO: Found listing with ID: CX70522
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX70522%27 HTTP/1.1" 200 None
2026-03-30 09:05:35 [auto1.it] INFO: Scrape type for CX70522: 2
2026-03-30 09:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3db1b5b-59e3-541a-b2f7-06cc968536a7 with identifier: CX70522
2026-03-30 09:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3db1b5b-59e3-541a-b2f7-06cc968536a7 with scrape type 2
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3db1b5b-59e3-541a-b2f7-06cc968536a7 with scrape type 2
2026-03-30 09:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f3db1b5b-59e3-541a-b2f7-06cc968536a7, identifier: CX70522
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_2654cdfefe740e82257e099b2cedbfce.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_2654cdfefe740e82257e099b2cedbfce.jpg not downloaded yet
2026-03-30 09:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dfc4c271-1079-595c-b14d-8d12615cbfa6 with identifier: WA94787
2026-03-30 09:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dfc4c271-1079-595c-b14d-8d12615cbfa6 with identifier: WA94787
2026-03-30 09:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dfc4c271-1079-595c-b14d-8d12615cbfa6 with identifier: WA94787 to the API
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WA94787>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:41:32Z',
 'fuel_type': 'diesel',
 'id': 'dfc4c271-1079-595c-b14d-8d12615cbfa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA94787',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 73036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_20397d5b766a34c34e60c3d7444357fc.jpg',
                'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_3cc58c0dcff0b15bc543203c0119c446.jpg',
                'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_80f4b30a548d850c57bef842e673bae8.jpg',
                'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_896f050229d208e693598558d178ec8b.jpg',
                'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_aa8823abbca26ecfbc8c4bd0c9ca5962.jpg',
                'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_4244d52e88894c24050ba6221238a79a.jpg',
                'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_dbe69ec602f9d35e15c4230b2a0235fc.jpg',
                'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_07962fea5fb13a4c1aaddef5c70d174a.jpg',
                'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_dbde69b57b79f8208113ff36d2d235b8.jpg',
                'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_48ecf68418ec5bbd7e966b32c719a805.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc4c271-1079-595c-b14d-8d12615cbfa6/dfc4c271-1079-595c-b14d-8d12615cbfa6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_20397d5b766a34c34e60c3d7444357fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc4c271-1079-595c-b14d-8d12615cbfa6/dfc4c271-1079-595c-b14d-8d12615cbfa6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_3cc58c0dcff0b15bc543203c0119c446.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc4c271-1079-595c-b14d-8d12615cbfa6/dfc4c271-1079-595c-b14d-8d12615cbfa6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_80f4b30a548d850c57bef842e673bae8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc4c271-1079-595c-b14d-8d12615cbfa6/dfc4c271-1079-595c-b14d-8d12615cbfa6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_896f050229d208e693598558d178ec8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc4c271-1079-595c-b14d-8d12615cbfa6/dfc4c271-1079-595c-b14d-8d12615cbfa6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_aa8823abbca26ecfbc8c4bd0c9ca5962.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc4c271-1079-595c-b14d-8d12615cbfa6/dfc4c271-1079-595c-b14d-8d12615cbfa6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_4244d52e88894c24050ba6221238a79a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc4c271-1079-595c-b14d-8d12615cbfa6/dfc4c271-1079-595c-b14d-8d12615cbfa6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_dbe69ec602f9d35e15c4230b2a0235fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc4c271-1079-595c-b14d-8d12615cbfa6/dfc4c271-1079-595c-b14d-8d12615cbfa6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_07962fea5fb13a4c1aaddef5c70d174a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc4c271-1079-595c-b14d-8d12615cbfa6/dfc4c271-1079-595c-b14d-8d12615cbfa6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_dbde69b57b79f8208113ff36d2d235b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc4c271-1079-595c-b14d-8d12615cbfa6/dfc4c271-1079-595c-b14d-8d12615cbfa6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e1/f1e1b8352bce00f8c8426af6b825e6be/pa/WA94787_48ecf68418ec5bbd7e966b32c719a805.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Combo 1.5 CDTI Doppelkabine',
 'transmission': 'manual',
 'trim': 'Doppelkabine',
 'year': 2022}
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA94787%27 HTTP/1.1" 200 None
2026-03-30 09:05:35 [auto1.it] INFO: Saving data for WA94787: {'created_time': 1774861535.680407, 'last_price_update_time': 1774861535.680417, 'auction_closing_time': 1774971692.0}
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WA94787') HTTP/1.1" 204 0
2026-03-30 09:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f23c2758-3cf7-594f-a099-9521d3244bb4 with identifier: GA22711
2026-03-30 09:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f23c2758-3cf7-594f-a099-9521d3244bb4 with identifier: GA22711
2026-03-30 09:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f23c2758-3cf7-594f-a099-9521d3244bb4 with identifier: GA22711 to the API
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_ba502055f5e684ab3bec3b93f879e580.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:27:36Z',
 'fuel_type': 'diesel',
 'id': 'f23c2758-3cf7-594f-a099-9521d3244bb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA22711',
 'listing': 'auction',
 'location': 'IT, Rende',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 245576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_dd1450349f15c46ae4a7e770a601ff28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_ba502055f5e684ab3bec3b93f879e580.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_e8ff7bb39992f575e22675a14af696e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_11be970c4c3618bb44ffc2a9f5335959.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_b3fc17ea7ff0a90b1a1d8616277fd7b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_9134262e250a2dbd3e7a296a0a55d2a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_ef77b0df4b94b5aa822afd1c160bbca9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_e3f598681b4bec0d93c48401ebe47d76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_03b56df0f458fb862d364bdff097e97e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23c2758-3cf7-594f-a099-9521d3244bb4/f23c2758-3cf7-594f-a099-9521d3244bb4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/2c/2d2c839fa69b2750385672b29328bf20/pa/GA22711_a1e58ce70d8c32d64b5a355a1c4d3a02.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi 360 4x4',
 'transmission': 'manual',
 'trim': '360 4x4',
 'year': 2017}
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA22711%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [auto1.it] INFO: Saving data for GA22711: {'created_time': 1774861536.079786, 'last_price_update_time': 1774861536.079797, 'auction_closing_time': 1774970856.0}
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GA22711') HTTP/1.1" 204 0
2026-03-30 09:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f47752c3-4d30-5ecd-baca-78a158010ea5 with identifier: LE83570
2026-03-30 09:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f47752c3-4d30-5ecd-baca-78a158010ea5 with identifier: LE83570
2026-03-30 09:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f47752c3-4d30-5ecd-baca-78a158010ea5 with identifier: LE83570 to the API
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_b4bafed002b7f56cde419b49ce740722.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:13:23Z',
 'fuel_type': 'petrol',
 'id': 'f47752c3-4d30-5ecd-baca-78a158010ea5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE83570',
 'listing': 'auction',
 'location': 'IT, Catania',
 'make': 'Fiat',
 'model': '500',
 'odometer': 42116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_706316b9347ee99a56d5568214f68a0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_764542bf971bf13d0b2bd184cacfb68b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_0d2f370f1c41ab98552333dcdd0c06b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2489357,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_318b6e2505735e8d9062a330a8229f95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_11f4d10039ab9a5672d1f1365f966ea7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577227,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_015365954e7ce03974a9cbac270fc949.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_212be9cba6ee787ce8ec964bff65489d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_6984023a8a593be9dec3036e1c245072.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_00b1c6e6be75839de20428c53cccb871.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47752c3-4d30-5ecd-baca-78a158010ea5/f47752c3-4d30-5ecd-baca-78a158010ea5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c7/c2c7b6fcb7e64a8465f3e618f65ca96e/pa/LE83570_b4bafed002b7f56cde419b49ce740722.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 By Diesel',
 'transmission': 'automatic',
 'trim': 'By Diesel',
 'year': 2009}
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE83570%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [auto1.it] INFO: Saving data for LE83570: {'created_time': 1774861536.522181, 'last_price_update_time': 1774861536.522191, 'auction_closing_time': 1774970003.0}
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LE83570') HTTP/1.1" 204 0
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: BY77891
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY77891%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [auto1.it] INFO: Scrape type for BY77891: 2
2026-03-30 09:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49968954-f57f-535e-91c0-e0e9ea447456 with identifier: BY77891
2026-03-30 09:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49968954-f57f-535e-91c0-e0e9ea447456 with scrape type 2
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49968954-f57f-535e-91c0-e0e9ea447456 with scrape type 2
2026-03-30 09:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49968954-f57f-535e-91c0-e0e9ea447456, identifier: BY77891
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: BF99342
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: FU33041
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: NY98259
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: WR25363
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: XE78625
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: AU72091
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU72091%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [auto1.it] INFO: Scrape type for AU72091: 2
2026-03-30 09:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a4c5b72-92d8-5e04-a9f1-2683b8ad2cb0 with identifier: AU72091
2026-03-30 09:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a4c5b72-92d8-5e04-a9f1-2683b8ad2cb0 with scrape type 2
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a4c5b72-92d8-5e04-a9f1-2683b8ad2cb0 with scrape type 2
2026-03-30 09:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8a4c5b72-92d8-5e04-a9f1-2683b8ad2cb0, identifier: AU72091
2026-03-30 09:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f3db1b5b-59e3-541a-b2f7-06cc968536a7 with identifier: CX70522
2026-03-30 09:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f3db1b5b-59e3-541a-b2f7-06cc968536a7 with identifier: CX70522
2026-03-30 09:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f3db1b5b-59e3-541a-b2f7-06cc968536a7 with identifier: CX70522 to the API
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:27:36Z',
 'fuel_type': 'diesel',
 'id': 'f3db1b5b-59e3-541a-b2f7-06cc968536a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX70522',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 52952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-30',
 'seller_name': None,
 'title': 'Jeep Compass 1.6 M-Jet 80th Anniversary FWD',
 'transmission': 'manual',
 'trim': '80th Anniversary FWD',
 'year': 2021}
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX70522%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [auto1.it] INFO: Saving data for CX70522: {'auction_closing_time': 1774884456.0, 'created_time': 1773849145.992409, 'last_price_update_time': 1774861537.095208}
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CX70522') HTTP/1.1" 204 0
2026-03-30 09:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d50590>
2026-03-30 09:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F37%252F2937f9488dd4455b62974f16bda47052%252Fpa%252FGE66634_688b3bbd71f5d340b3352eeebdd93b6a.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_688b3bbd71f5d340b3352eeebdd93b6a.jpg saved to cache
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3894e5d6-f6df-53e3-89d9-a84134c634d2
2026-03-30 09:05:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3894e5d6-f6df-53e3-89d9-a84134c634d2, skipping ID generation
2026-03-30 09:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3894e5d6-f6df-53e3-89d9-a84134c634d2 with scrape type 1
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3894e5d6-f6df-53e3-89d9-a84134c634d2 sending to next pipeline
2026-03-30 09:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3894e5d6-f6df-53e3-89d9-a84134c634d2, identifier: GE66634
2026-03-30 09:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49968954-f57f-535e-91c0-e0e9ea447456 with identifier: BY77891
2026-03-30 09:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49968954-f57f-535e-91c0-e0e9ea447456 with identifier: BY77891
2026-03-30 09:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49968954-f57f-535e-91c0-e0e9ea447456 with identifier: BY77891 to the API
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:21:42Z',
 'fuel_type': 'petrol',
 'id': '49968954-f57f-535e-91c0-e0e9ea447456',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY77891',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS3',
 'odometer': 17399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-20',
 'seller_name': None,
 'title': 'DS Automobiles DS3 1.2 Mild-Hybrid Étoile',
 'transmission': 'automatic',
 'trim': 'Étoile',
 'year': 2025}
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY77891%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [auto1.it] INFO: Saving data for BY77891: {'auction_closing_time': 1774884102.0, 'created_time': 1774774844.448876, 'last_price_update_time': 1774861537.660474}
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BY77891') HTTP/1.1" 204 0
2026-03-30 09:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8a4c5b72-92d8-5e04-a9f1-2683b8ad2cb0 with identifier: AU72091
2026-03-30 09:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8a4c5b72-92d8-5e04-a9f1-2683b8ad2cb0 with identifier: AU72091
2026-03-30 09:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8a4c5b72-92d8-5e04-a9f1-2683b8ad2cb0 with identifier: AU72091 to the API
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:14:25Z',
 'fuel_type': 'petrol',
 'id': '8a4c5b72-92d8-5e04-a9f1-2683b8ad2cb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU72091',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 99175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-30',
 'seller_name': None,
 'title': 'Nissan Note 1.4 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2006}
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU72091%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [auto1.it] INFO: Saving data for AU72091: {'auction_closing_time': 1774883665.0, 'created_time': 1774645541.112637, 'last_price_update_time': 1774861537.970183}
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AU72091') HTTP/1.1" 204 0
2026-03-30 09:05:37 [auto1.it] INFO: Found listing with ID: RN93859
2026-03-30 09:05:37 [auto1.it] INFO: Found listing with ID: MG94028
2026-03-30 09:05:37 [auto1.it] INFO: Found listing with ID: ET76297
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET76297%27 HTTP/1.1" 200 None
2026-03-30 09:05:38 [auto1.it] INFO: Scrape type for ET76297: 2
2026-03-30 09:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53835fd4-2e51-5443-9325-61563cadc51b with identifier: ET76297
2026-03-30 09:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53835fd4-2e51-5443-9325-61563cadc51b with scrape type 2
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53835fd4-2e51-5443-9325-61563cadc51b with scrape type 2
2026-03-30 09:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 53835fd4-2e51-5443-9325-61563cadc51b, identifier: ET76297
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_7896aed36432887aa4fb907e3ba80e22.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_7896aed36432887aa4fb907e3ba80e22.jpg not downloaded yet
2026-03-30 09:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY38939/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3894e5d6-f6df-53e3-89d9-a84134c634d2 with identifier: GE66634
2026-03-30 09:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3894e5d6-f6df-53e3-89d9-a84134c634d2 with identifier: GE66634
2026-03-30 09:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3894e5d6-f6df-53e3-89d9-a84134c634d2 with identifier: GE66634 to the API
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_688b3bbd71f5d340b3352eeebdd93b6a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:04:25Z',
 'fuel_type': 'petrol',
 'id': '3894e5d6-f6df-53e3-89d9-a84134c634d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE66634',
 'listing': 'auction',
 'location': 'IT, Mariano Comense',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 73646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_2052f672e546865870a1a2c839b88532.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_80f0da8a3d9a74f19d30de45f0c9f7c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_128809914087a8d2bd16da7cb6d4064d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_688b3bbd71f5d340b3352eeebdd93b6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_e3df93f65c076b720b5fdd0b87d90b61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_1849ed482acd5a82fad60c3b4c23f69a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_961526ea95845298a5a253c18970982b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_e85b095002c5312ce11d2922af750651.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_7d2948316c947dca25ba4cea8cb893f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3894e5d6-f6df-53e3-89d9-a84134c634d2/3894e5d6-f6df-53e3-89d9-a84134c634d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/37/2937f9488dd4455b62974f16bda47052/pa/GE66634_3f3df36a5fd529039d9b263d45306641.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2012}
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE66634%27 HTTP/1.1" 200 None
2026-03-30 09:05:38 [auto1.it] INFO: Saving data for GE66634: {'created_time': 1774861538.984845, 'last_price_update_time': 1774861538.984855, 'auction_closing_time': 1774969465.0}
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GE66634') HTTP/1.1" 204 0
2026-03-30 09:05:39 [auto1.it] INFO: Found listing with ID: FT91483
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT91483%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [auto1.it] INFO: Scrape type for FT91483: 2
2026-03-30 09:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72a7a1a4-f068-56fc-b61f-cfa85e26906c with identifier: FT91483
2026-03-30 09:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72a7a1a4-f068-56fc-b61f-cfa85e26906c with scrape type 2
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72a7a1a4-f068-56fc-b61f-cfa85e26906c with scrape type 2
2026-03-30 09:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 72a7a1a4-f068-56fc-b61f-cfa85e26906c, identifier: FT91483
2026-03-30 09:05:39 [auto1.it] INFO: Found listing with ID: UZ37395
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ37395%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [auto1.it] INFO: Scrape type for UZ37395: 2
2026-03-30 09:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b331e58-671a-50a5-9a21-e1b6ec82c685 with identifier: UZ37395
2026-03-30 09:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b331e58-671a-50a5-9a21-e1b6ec82c685 with scrape type 2
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b331e58-671a-50a5-9a21-e1b6ec82c685 with scrape type 2
2026-03-30 09:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b331e58-671a-50a5-9a21-e1b6ec82c685, identifier: UZ37395
2026-03-30 09:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 53835fd4-2e51-5443-9325-61563cadc51b with identifier: ET76297
2026-03-30 09:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 53835fd4-2e51-5443-9325-61563cadc51b with identifier: ET76297
2026-03-30 09:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 53835fd4-2e51-5443-9325-61563cadc51b with identifier: ET76297 to the API
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:01:31Z',
 'fuel_type': 'diesel',
 'id': '53835fd4-2e51-5443-9325-61563cadc51b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET76297',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 214265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-13',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 2.0 HDi Chrono',
 'transmission': 'manual',
 'trim': 'Chrono',
 'year': 2005}
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET76297%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [auto1.it] INFO: Saving data for ET76297: {'auction_closing_time': 1774882891.0, 'created_time': 1774559125.381363, 'last_price_update_time': 1774861539.572996}
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET76297') HTTP/1.1" 204 0
2026-03-30 09:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cc9710>
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_dfe941985fc7098eb54772bb2ea58443.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_dfe941985fc7098eb54772bb2ea58443.jpg saved to cache
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e338fc77-6cf7-590d-b9fd-095d73f56551
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d9d3d0>
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_c44ebbdf789f65defe6d932ca4cbb47c.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_c44ebbdf789f65defe6d932ca4cbb47c.jpg saved to cache
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e338fc77-6cf7-590d-b9fd-095d73f56551
2026-03-30 09:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_7c378b19bb874bf2803fc22446be08ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_ef0b916bdc5582d4dd4c4a715be19c21.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 72a7a1a4-f068-56fc-b61f-cfa85e26906c with identifier: FT91483
2026-03-30 09:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 72a7a1a4-f068-56fc-b61f-cfa85e26906c with identifier: FT91483
2026-03-30 09:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 72a7a1a4-f068-56fc-b61f-cfa85e26906c with identifier: FT91483 to the API
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:45:32Z',
 'fuel_type': 'diesel',
 'id': '72a7a1a4-f068-56fc-b61f-cfa85e26906c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT91483',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 125553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-02',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'manual',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2020}
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT91483%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [auto1.it] INFO: Saving data for FT91483: {'auction_closing_time': 1774885532.0, 'created_time': 1774774846.665513, 'last_price_update_time': 1774861539.981165}
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FT91483') HTTP/1.1" 204 0
2026-03-30 09:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b331e58-671a-50a5-9a21-e1b6ec82c685 with identifier: UZ37395
2026-03-30 09:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b331e58-671a-50a5-9a21-e1b6ec82c685 with identifier: UZ37395
2026-03-30 09:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b331e58-671a-50a5-9a21-e1b6ec82c685 with identifier: UZ37395 to the API
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:51:55Z',
 'fuel_type': 'diesel',
 'id': '6b331e58-671a-50a5-9a21-e1b6ec82c685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ37395',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 54104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-30',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ37395%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [auto1.it] INFO: Saving data for UZ37395: {'auction_closing_time': 1774885915.0, 'created_time': 1774774853.098292, 'last_price_update_time': 1774861540.35027}
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UZ37395') HTTP/1.1" 204 0
2026-03-30 09:05:40 [auto1.it] INFO: Found listing with ID: KC92917
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC92917%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [auto1.it] INFO: Scrape type for KC92917: 2
2026-03-30 09:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a36b97e-fd5e-5441-95bf-d3f63ac960f6 with identifier: KC92917
2026-03-30 09:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a36b97e-fd5e-5441-95bf-d3f63ac960f6 with scrape type 2
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a36b97e-fd5e-5441-95bf-d3f63ac960f6 with scrape type 2
2026-03-30 09:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a36b97e-fd5e-5441-95bf-d3f63ac960f6, identifier: KC92917
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_6a1e42e29a4a8f89392118df4cb2be33.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_6a1e42e29a4a8f89392118df4cb2be33.jpg not downloaded yet
2026-03-30 09:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF81077/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR67041/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:40 [auto1.it] INFO: Found listing with ID: WK11111
2026-03-30 09:05:40 [auto1.it] INFO: Found listing with ID: RA61931
2026-03-30 09:05:40 [auto1.it] INFO: Found listing with ID: FT31182
2026-03-30 09:05:40 [auto1.it] INFO: Found listing with ID: ET06239
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET06239%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [auto1.it] INFO: Scrape type for ET06239: 2
2026-03-30 09:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97231a1d-f1f7-5a17-a6cf-743816f08a5e with identifier: ET06239
2026-03-30 09:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97231a1d-f1f7-5a17-a6cf-743816f08a5e with scrape type 2
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97231a1d-f1f7-5a17-a6cf-743816f08a5e with scrape type 2
2026-03-30 09:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97231a1d-f1f7-5a17-a6cf-743816f08a5e, identifier: ET06239
2026-03-30 09:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a36b97e-fd5e-5441-95bf-d3f63ac960f6 with identifier: KC92917
2026-03-30 09:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a36b97e-fd5e-5441-95bf-d3f63ac960f6 with identifier: KC92917
2026-03-30 09:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a36b97e-fd5e-5441-95bf-d3f63ac960f6 with identifier: KC92917 to the API
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:55:46Z',
 'fuel_type': 'diesel',
 'id': '7a36b97e-fd5e-5441-95bf-d3f63ac960f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC92917',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 76782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-06',
 'seller_name': None,
 'title': 'BMW X5 sDrive 25d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC92917%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [auto1.it] INFO: Saving data for KC92917: {'auction_closing_time': 1774886146.0, 'created_time': 1774774862.290614, 'last_price_update_time': 1774861540.998846}
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC92917') HTTP/1.1" 204 0
2026-03-30 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB25673/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV29599> (referer: https://www.auto1.com/v1/car-details-view/RV29599/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97231a1d-f1f7-5a17-a6cf-743816f08a5e with identifier: ET06239
2026-03-30 09:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97231a1d-f1f7-5a17-a6cf-743816f08a5e with identifier: ET06239
2026-03-30 09:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97231a1d-f1f7-5a17-a6cf-743816f08a5e with identifier: ET06239 to the API
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:54:05Z',
 'fuel_type': 'diesel',
 'id': '97231a1d-f1f7-5a17-a6cf-743816f08a5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET06239',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Lybra',
 'odometer': 171839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-02-24',
 'seller_name': None,
 'title': 'Lancia Lybra 1.9 Turbodiesel JTD',
 'transmission': 'manual',
 'trim': 'JTD',
 'year': 2002}
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET06239%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [auto1.it] INFO: Saving data for ET06239: {'auction_closing_time': 1774886045.0, 'created_time': 1774559114.207021, 'last_price_update_time': 1774861541.297842}
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET06239') HTTP/1.1" 204 0
2026-03-30 09:05:41 [auto1.it] INFO: Found listing with ID: LT09174
2026-03-30 09:05:41 [auto1.it] INFO: Found listing with ID: JK70304
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK70304%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [auto1.it] INFO: Scrape type for JK70304: 2
2026-03-30 09:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adadddb6-cfc9-51bc-9e92-406ab18b984e with identifier: JK70304
2026-03-30 09:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adadddb6-cfc9-51bc-9e92-406ab18b984e with scrape type 2
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adadddb6-cfc9-51bc-9e92-406ab18b984e with scrape type 2
2026-03-30 09:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: adadddb6-cfc9-51bc-9e92-406ab18b984e, identifier: JK70304
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_361bfbbc259ed246048fdf7a0839f4ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_361bfbbc259ed246048fdf7a0839f4ff.jpg not downloaded yet
2026-03-30 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM87758> (referer: https://www.auto1.com/v1/car-details-view/YM87758/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_0799b53e66dbac3268a85602ee8cbdfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_2654cdfefe740e82257e099b2cedbfce.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:41 [auto1.it] INFO: Found listing with ID: MF53034
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MF53034%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [auto1.it] INFO: Scrape type for MF53034: 2
2026-03-30 09:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9267082c-f494-533e-b9bc-f6002c98a68f with identifier: MF53034
2026-03-30 09:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9267082c-f494-533e-b9bc-f6002c98a68f with scrape type 2
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9267082c-f494-533e-b9bc-f6002c98a68f with scrape type 2
2026-03-30 09:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9267082c-f494-533e-b9bc-f6002c98a68f, identifier: MF53034
2026-03-30 09:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: adadddb6-cfc9-51bc-9e92-406ab18b984e with identifier: JK70304
2026-03-30 09:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: adadddb6-cfc9-51bc-9e92-406ab18b984e with identifier: JK70304
2026-03-30 09:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: adadddb6-cfc9-51bc-9e92-406ab18b984e with identifier: JK70304 to the API
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:36:18Z',
 'fuel_type': 'petrol',
 'id': 'adadddb6-cfc9-51bc-9e92-406ab18b984e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK70304',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 182333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-30',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2009}
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK70304%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [auto1.it] INFO: Saving data for JK70304: {'auction_closing_time': 1774884978.0, 'created_time': 1773694981.814682, 'last_price_update_time': 1774861541.852025}
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JK70304') HTTP/1.1" 204 0
2026-03-30 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:41 [auto1.it] INFO: Channel: 24h | Page: 24 | totalHits: 3303 | hits on page: 40
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d9f3d0>
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_7c378b19bb874bf2803fc22446be08ad.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_7c378b19bb874bf2803fc22446be08ad.jpg saved to cache
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e338fc77-6cf7-590d-b9fd-095d73f56551
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c66290>
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_ef0b916bdc5582d4dd4c4a715be19c21.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_ef0b916bdc5582d4dd4c4a715be19c21.jpg saved to cache
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e338fc77-6cf7-590d-b9fd-095d73f56551
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_7896aed36432887aa4fb907e3ba80e22.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9267082c-f494-533e-b9bc-f6002c98a68f with identifier: MF53034
2026-03-30 09:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9267082c-f494-533e-b9bc-f6002c98a68f with identifier: MF53034
2026-03-30 09:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9267082c-f494-533e-b9bc-f6002c98a68f with identifier: MF53034 to the API
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:18:14Z',
 'fuel_type': 'diesel',
 'id': '9267082c-f494-533e-b9bc-f6002c98a68f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF53034',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 364887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-03-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.9 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2002}
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MF53034%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [auto1.it] INFO: Saving data for MF53034: {'auction_closing_time': 1774883894.0, 'created_time': 1773241736.441939, 'last_price_update_time': 1774861542.259545}
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MF53034') HTTP/1.1" 204 0
2026-03-30 09:05:42 [auto1.it] INFO: Found listing with ID: TT78909
2026-03-30 09:05:42 [auto1.it] INFO: Found listing with ID: EH72083
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH72083%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [auto1.it] INFO: Scrape type for EH72083: 2
2026-03-30 09:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1afcd35f-42cf-5910-ac85-2e9e8b3dc95b with identifier: EH72083
2026-03-30 09:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1afcd35f-42cf-5910-ac85-2e9e8b3dc95b with scrape type 2
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1afcd35f-42cf-5910-ac85-2e9e8b3dc95b with scrape type 2
2026-03-30 09:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1afcd35f-42cf-5910-ac85-2e9e8b3dc95b, identifier: EH72083
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_7ed0da886c023b2626b1b31e2225304a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_7ed0da886c023b2626b1b31e2225304a.jpg not downloaded yet
2026-03-30 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_4d2a867ad06d68c8e4de3e8059976eb1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:42 [auto1.it] INFO: Found listing with ID: SV79819
2026-03-30 09:05:42 [auto1.it] INFO: Found listing with ID: LB26900
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB26900%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [auto1.it] INFO: Scrape type for LB26900: 2
2026-03-30 09:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ca493fb-207a-5221-949c-696645256dd4 with identifier: LB26900
2026-03-30 09:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ca493fb-207a-5221-949c-696645256dd4 with scrape type 2
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ca493fb-207a-5221-949c-696645256dd4 with scrape type 2
2026-03-30 09:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ca493fb-207a-5221-949c-696645256dd4, identifier: LB26900
2026-03-30 09:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1afcd35f-42cf-5910-ac85-2e9e8b3dc95b with identifier: EH72083
2026-03-30 09:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1afcd35f-42cf-5910-ac85-2e9e8b3dc95b with identifier: EH72083
2026-03-30 09:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1afcd35f-42cf-5910-ac85-2e9e8b3dc95b with identifier: EH72083 to the API
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:13Z',
 'fuel_type': 'diesel',
 'id': '1afcd35f-42cf-5910-ac85-2e9e8b3dc95b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH72083',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 75287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-20',
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2019}
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH72083%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [auto1.it] INFO: Saving data for EH72083: {'auction_closing_time': 1774885573.0, 'created_time': 1774774867.094658, 'last_price_update_time': 1774861542.813074}
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EH72083') HTTP/1.1" 204 0
2026-03-30 09:05:42 [auto1.it] INFO: Found listing with ID: FF41288
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF41288%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [auto1.it] INFO: Scrape type for FF41288: 2
2026-03-30 09:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c6af6ba-9a1e-5518-90ff-0931264ebe78 with identifier: FF41288
2026-03-30 09:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c6af6ba-9a1e-5518-90ff-0931264ebe78 with scrape type 2
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c6af6ba-9a1e-5518-90ff-0931264ebe78 with scrape type 2
2026-03-30 09:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c6af6ba-9a1e-5518-90ff-0931264ebe78, identifier: FF41288
2026-03-30 09:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71433cce-0dc4-5f0e-b958-980f9a360beb with identifier: RV29599
2026-03-30 09:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71433cce-0dc4-5f0e-b958-980f9a360beb with scrape type 1
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71433cce-0dc4-5f0e-b958-980f9a360beb
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_8ff7529962f3006a401a061977e1bfcb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_8ff7529962f3006a401a061977e1bfcb.jpg not downloaded yet
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_6a1e42e29a4a8f89392118df4cb2be33.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_385f184d260a89d206ea90050547dfc0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ca493fb-207a-5221-949c-696645256dd4 with identifier: LB26900
2026-03-30 09:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ca493fb-207a-5221-949c-696645256dd4 with identifier: LB26900
2026-03-30 09:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5ca493fb-207a-5221-949c-696645256dd4 with identifier: LB26900 to the API
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:08:21Z',
 'fuel_type': 'diesel',
 'id': '5ca493fb-207a-5221-949c-696645256dd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB26900',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 130028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 310 L1 Sport',
 'transmission': 'automatic',
 'trim': '310 L1 Sport',
 'year': 2021}
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB26900%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [auto1.it] INFO: Saving data for LB26900: {'auction_closing_time': 1774883301.0, 'created_time': 1774774855.94043, 'last_price_update_time': 1774861543.483416}
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LB26900') HTTP/1.1" 204 0
2026-03-30 09:05:43 [auto1.it] INFO: Found listing with ID: YW20970
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW20970%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [auto1.it] INFO: Scrape type for YW20970: 2
2026-03-30 09:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67fae9a0-0e78-51d7-8d7b-911a147da635 with identifier: YW20970
2026-03-30 09:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67fae9a0-0e78-51d7-8d7b-911a147da635 with scrape type 2
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67fae9a0-0e78-51d7-8d7b-911a147da635 with scrape type 2
2026-03-30 09:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 67fae9a0-0e78-51d7-8d7b-911a147da635, identifier: YW20970
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_18d763597cd1bca0b44b11aba20f49b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_18d763597cd1bca0b44b11aba20f49b7.jpg not downloaded yet
2026-03-30 09:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c6af6ba-9a1e-5518-90ff-0931264ebe78 with identifier: FF41288
2026-03-30 09:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c6af6ba-9a1e-5518-90ff-0931264ebe78 with identifier: FF41288
2026-03-30 09:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c6af6ba-9a1e-5518-90ff-0931264ebe78 with identifier: FF41288 to the API
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:06:12Z',
 'fuel_type': 'petrol',
 'id': '5c6af6ba-9a1e-5518-90ff-0931264ebe78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF41288',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 75345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2021}
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF41288%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [auto1.it] INFO: Saving data for FF41288: {'auction_closing_time': 1774883172.0, 'created_time': 1774774883.247238, 'last_price_update_time': 1774861543.961768}
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FF41288') HTTP/1.1" 204 0
2026-03-30 09:05:43 [auto1.it] INFO: Found listing with ID: PS84479
2026-03-30 09:05:43 [auto1.it] INFO: Found listing with ID: AK50840
2026-03-30 09:05:43 [auto1.it] INFO: Found listing with ID: FR18393
2026-03-30 09:05:43 [auto1.it] INFO: Found listing with ID: GY48890
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY48890%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [auto1.it] INFO: Scrape type for GY48890: 2
2026-03-30 09:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bd9f99b-5d5e-5e9e-bed2-3dad628f8112 with identifier: GY48890
2026-03-30 09:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd9f99b-5d5e-5e9e-bed2-3dad628f8112 with scrape type 2
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bd9f99b-5d5e-5e9e-bed2-3dad628f8112 with scrape type 2
2026-03-30 09:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5bd9f99b-5d5e-5e9e-bed2-3dad628f8112, identifier: GY48890
2026-03-30 09:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 67fae9a0-0e78-51d7-8d7b-911a147da635 with identifier: YW20970
2026-03-30 09:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 67fae9a0-0e78-51d7-8d7b-911a147da635 with identifier: YW20970
2026-03-30 09:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 67fae9a0-0e78-51d7-8d7b-911a147da635 with identifier: YW20970 to the API
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:33:32Z',
 'fuel_type': 'diesel',
 'id': '67fae9a0-0e78-51d7-8d7b-911a147da635',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW20970',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Phedra',
 'odometer': 301559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-12',
 'seller_name': None,
 'title': 'Lancia Phedra 2.0 JTD Multijet Oro',
 'transmission': 'manual',
 'trim': 'Multijet Oro',
 'year': 2009}
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW20970%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [auto1.it] INFO: Saving data for YW20970: {'auction_closing_time': 1774884812.0, 'created_time': 1774559100.955788, 'last_price_update_time': 1774861544.403396}
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YW20970') HTTP/1.1" 204 0
2026-03-30 09:05:44 [auto1.it] INFO: Found listing with ID: ST04114
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST04114%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [auto1.it] INFO: Scrape type for ST04114: 2
2026-03-30 09:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd826c47-f272-55b7-b23d-d4df049bdf29 with identifier: ST04114
2026-03-30 09:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd826c47-f272-55b7-b23d-d4df049bdf29 with scrape type 2
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd826c47-f272-55b7-b23d-d4df049bdf29 with scrape type 2
2026-03-30 09:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fd826c47-f272-55b7-b23d-d4df049bdf29, identifier: ST04114
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_d728cb75124227a1a18b53a97823c600.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_d728cb75124227a1a18b53a97823c600.jpg not downloaded yet
2026-03-30 09:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05ab94e1-773f-56ff-bdf7-5084d0b1410c with identifier: YM87758
2026-03-30 09:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05ab94e1-773f-56ff-bdf7-5084d0b1410c with scrape type 1
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05ab94e1-773f-56ff-bdf7-5084d0b1410c
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F6f%252F426f8d85440b4a52a3f97f9a789366bb%252Fpa%252FYM87758_500a4a376ce4e83c6be604b04e6dcab0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_500a4a376ce4e83c6be604b04e6dcab0.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F6f%252F426f8d85440b4a52a3f97f9a789366bb%252Fpa%252FYM87758_259deeb5dc24756709057e10acc3feda.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_259deeb5dc24756709057e10acc3feda.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F6f%252F426f8d85440b4a52a3f97f9a789366bb%252Fpa%252FYM87758_8e6a33c8daaf5d6877959283a7b7621b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_8e6a33c8daaf5d6877959283a7b7621b.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F6f%252F426f8d85440b4a52a3f97f9a789366bb%252Fpa%252FYM87758_b3aacc82342a3006bce57e42890f841e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_b3aacc82342a3006bce57e42890f841e.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F6f%252F426f8d85440b4a52a3f97f9a789366bb%252Fpa%252FYM87758_00617a8129be068a0a4a79517429eb19.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_00617a8129be068a0a4a79517429eb19.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F6f%252F426f8d85440b4a52a3f97f9a789366bb%252Fpa%252FYM87758_080138357deb773eb74e8ea479c217dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_080138357deb773eb74e8ea479c217dc.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F6f%252F426f8d85440b4a52a3f97f9a789366bb%252Fpa%252FYM87758_c59c235606688d2824665a001fb7cacc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_c59c235606688d2824665a001fb7cacc.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F6f%252F426f8d85440b4a52a3f97f9a789366bb%252Fpa%252FYM87758_ac0d1dd972f04656ee32c2a084c69d8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_ac0d1dd972f04656ee32c2a084c69d8c.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F6f%252F426f8d85440b4a52a3f97f9a789366bb%252Fpa%252FYM87758_63311389468eb3f4b9e4bc3aba859998.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_63311389468eb3f4b9e4bc3aba859998.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F6f%252F426f8d85440b4a52a3f97f9a789366bb%252Fpa%252FYM87758_7b4bc9a05da07aad17b708146cf6285c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_7b4bc9a05da07aad17b708146cf6285c.jpg already downloaded
2026-03-30 09:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 05ab94e1-773f-56ff-bdf7-5084d0b1410c, identifier: YM87758
2026-03-30 09:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06365a10>
2026-03-30 09:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F36%252F1e36fa97d2a60516498288529ef03c56%252Fpa%252FZH20956_0799b53e66dbac3268a85602ee8cbdfa.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_0799b53e66dbac3268a85602ee8cbdfa.jpg saved to cache
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c16e0be7-5c56-52e8-a902-71a1318b4aed
2026-03-30 09:05:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c16e0be7-5c56-52e8-a902-71a1318b4aed, skipping ID generation
2026-03-30 09:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c16e0be7-5c56-52e8-a902-71a1318b4aed with scrape type 1
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c16e0be7-5c56-52e8-a902-71a1318b4aed sending to next pipeline
2026-03-30 09:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c16e0be7-5c56-52e8-a902-71a1318b4aed, identifier: ZH20956
2026-03-30 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06209390>
2026-03-30 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_2654cdfefe740e82257e099b2cedbfce.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_2654cdfefe740e82257e099b2cedbfce.jpg saved to cache
2026-03-30 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e338fc77-6cf7-590d-b9fd-095d73f56551
2026-03-30 09:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d065c10>
2026-03-30 09:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_7896aed36432887aa4fb907e3ba80e22.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_7896aed36432887aa4fb907e3ba80e22.jpg saved to cache
2026-03-30 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e338fc77-6cf7-590d-b9fd-095d73f56551
2026-03-30 09:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5bd9f99b-5d5e-5e9e-bed2-3dad628f8112 with identifier: GY48890
2026-03-30 09:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5bd9f99b-5d5e-5e9e-bed2-3dad628f8112 with identifier: GY48890
2026-03-30 09:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5bd9f99b-5d5e-5e9e-bed2-3dad628f8112 with identifier: GY48890 to the API
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:29:29Z',
 'fuel_type': 'diesel',
 'id': '5bd9f99b-5d5e-5e9e-bed2-3dad628f8112',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY48890',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 125456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-30',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2017}
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY48890%27 HTTP/1.1" 200 None
2026-03-30 09:05:45 [auto1.it] INFO: Saving data for GY48890: {'auction_closing_time': 1774884569.0, 'created_time': 1774774856.581595, 'last_price_update_time': 1774861545.85034}
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY48890') HTTP/1.1" 204 0
2026-03-30 09:05:45 [auto1.it] INFO: Found listing with ID: XH54291
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH54291%27 HTTP/1.1" 200 None
2026-03-30 09:05:45 [auto1.it] INFO: Scrape type for XH54291: 2
2026-03-30 09:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 180d6918-580e-5525-bc26-88f3669db7e2 with identifier: XH54291
2026-03-30 09:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 180d6918-580e-5525-bc26-88f3669db7e2 with scrape type 2
2026-03-30 09:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 180d6918-580e-5525-bc26-88f3669db7e2 with scrape type 2
2026-03-30 09:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 180d6918-580e-5525-bc26-88f3669db7e2, identifier: XH54291
2026-03-30 09:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fd826c47-f272-55b7-b23d-d4df049bdf29 with identifier: ST04114
2026-03-30 09:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fd826c47-f272-55b7-b23d-d4df049bdf29 with identifier: ST04114
2026-03-30 09:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fd826c47-f272-55b7-b23d-d4df049bdf29 with identifier: ST04114 to the API
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:30:49Z',
 'fuel_type': 'petrol',
 'id': 'fd826c47-f272-55b7-b23d-d4df049bdf29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST04114',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Idea',
 'odometer': 152868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-29',
 'seller_name': None,
 'title': 'Fiat Idea 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST04114%27 HTTP/1.1" 200 None
2026-03-30 09:05:46 [auto1.it] INFO: Saving data for ST04114: {'auction_closing_time': 1774884649.0, 'created_time': 1773241834.669482, 'last_price_update_time': 1774861546.347705}
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ST04114') HTTP/1.1" 204 0
2026-03-30 09:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 05ab94e1-773f-56ff-bdf7-5084d0b1410c with identifier: YM87758
2026-03-30 09:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 05ab94e1-773f-56ff-bdf7-5084d0b1410c with identifier: YM87758
2026-03-30 09:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 05ab94e1-773f-56ff-bdf7-5084d0b1410c with identifier: YM87758 to the API
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YM87758>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:18:56Z',
 'fuel_type': 'diesel',
 'id': '05ab94e1-773f-56ff-bdf7-5084d0b1410c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM87758',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 132364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_500a4a376ce4e83c6be604b04e6dcab0.jpg',
                'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_259deeb5dc24756709057e10acc3feda.jpg',
                'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_8e6a33c8daaf5d6877959283a7b7621b.jpg',
                'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_b3aacc82342a3006bce57e42890f841e.jpg',
                'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_00617a8129be068a0a4a79517429eb19.jpg',
                'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_080138357deb773eb74e8ea479c217dc.jpg',
                'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_c59c235606688d2824665a001fb7cacc.jpg',
                'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_ac0d1dd972f04656ee32c2a084c69d8c.jpg',
                'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_63311389468eb3f4b9e4bc3aba859998.jpg',
                'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_7b4bc9a05da07aad17b708146cf6285c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ab94e1-773f-56ff-bdf7-5084d0b1410c/05ab94e1-773f-56ff-bdf7-5084d0b1410c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_500a4a376ce4e83c6be604b04e6dcab0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ab94e1-773f-56ff-bdf7-5084d0b1410c/05ab94e1-773f-56ff-bdf7-5084d0b1410c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_259deeb5dc24756709057e10acc3feda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ab94e1-773f-56ff-bdf7-5084d0b1410c/05ab94e1-773f-56ff-bdf7-5084d0b1410c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3055572,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_8e6a33c8daaf5d6877959283a7b7621b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ab94e1-773f-56ff-bdf7-5084d0b1410c/05ab94e1-773f-56ff-bdf7-5084d0b1410c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_b3aacc82342a3006bce57e42890f841e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ab94e1-773f-56ff-bdf7-5084d0b1410c/05ab94e1-773f-56ff-bdf7-5084d0b1410c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2965377,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_00617a8129be068a0a4a79517429eb19.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ab94e1-773f-56ff-bdf7-5084d0b1410c/05ab94e1-773f-56ff-bdf7-5084d0b1410c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3063836,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_080138357deb773eb74e8ea479c217dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ab94e1-773f-56ff-bdf7-5084d0b1410c/05ab94e1-773f-56ff-bdf7-5084d0b1410c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3009724,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_c59c235606688d2824665a001fb7cacc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ab94e1-773f-56ff-bdf7-5084d0b1410c/05ab94e1-773f-56ff-bdf7-5084d0b1410c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3058076,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_ac0d1dd972f04656ee32c2a084c69d8c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ab94e1-773f-56ff-bdf7-5084d0b1410c/05ab94e1-773f-56ff-bdf7-5084d0b1410c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_63311389468eb3f4b9e4bc3aba859998.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ab94e1-773f-56ff-bdf7-5084d0b1410c/05ab94e1-773f-56ff-bdf7-5084d0b1410c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2911412,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/6f/426f8d85440b4a52a3f97f9a789366bb/pa/YM87758_7b4bc9a05da07aad17b708146cf6285c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 2.0 Multijet Cross Plus',
 'transmission': 'manual',
 'trim': 'Cross Plus',
 'year': 2015}
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM87758%27 HTTP/1.1" 200 None
2026-03-30 09:05:46 [auto1.it] INFO: Saving data for YM87758: {'created_time': 1774861546.764829, 'last_price_update_time': 1774861546.764846, 'auction_closing_time': 1774970336.0}
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YM87758') HTTP/1.1" 204 0
2026-03-30 09:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c16e0be7-5c56-52e8-a902-71a1318b4aed with identifier: ZH20956
2026-03-30 09:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c16e0be7-5c56-52e8-a902-71a1318b4aed with identifier: ZH20956
2026-03-30 09:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c16e0be7-5c56-52e8-a902-71a1318b4aed with identifier: ZH20956 to the API
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_0799b53e66dbac3268a85602ee8cbdfa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:01:48Z',
 'fuel_type': 'diesel',
 'id': 'c16e0be7-5c56-52e8-a902-71a1318b4aed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH20956',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Fiat',
 'model': '500',
 'odometer': 109584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_328798b298272eda1fd51567fd9967cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_43a013be1030deb3134eedafdc7559b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 849400,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_0799b53e66dbac3268a85602ee8cbdfa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_54c316b3f2112e1b7dd221129c895bad.jpg',
             'Width': 693},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_72053bbdf51805d3ccd906ec5207d2c4.jpg',
             'Width': 721},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_7940d4dacbbdd258c7932780f72a8a52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_c3ffa042b593d929d7749716db87fa4c.jpg',
             'Width': 639},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_58de5a740555c018a8d14ce633009c49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772898,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_1426b9320f137ec1f12c579940f87b41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16e0be7-5c56-52e8-a902-71a1318b4aed/c16e0be7-5c56-52e8-a902-71a1318b4aed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/36/1e36fa97d2a60516498288529ef03c56/pa/ZH20956_1e6039c55ef96fd7c6d8b86651c1cf31.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.3 M-Jet Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH20956%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [auto1.it] INFO: Saving data for ZH20956: {'created_time': 1774861547.293512, 'last_price_update_time': 1774861547.293523, 'auction_closing_time': 1774969308.0}
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH20956') HTTP/1.1" 204 0
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062d4c10>
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_4d2a867ad06d68c8e4de3e8059976eb1.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_4d2a867ad06d68c8e4de3e8059976eb1.jpg saved to cache
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0aef16de-37ed-51fd-9a2d-02a471d48637
2026-03-30 09:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_361bfbbc259ed246048fdf7a0839f4ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:47 [auto1.it] INFO: Found listing with ID: AV53481
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV53481%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [auto1.it] INFO: Scrape type for AV53481: 0
2026-03-30 09:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 180d6918-580e-5525-bc26-88f3669db7e2 with identifier: XH54291
2026-03-30 09:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 180d6918-580e-5525-bc26-88f3669db7e2 with identifier: XH54291
2026-03-30 09:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 180d6918-580e-5525-bc26-88f3669db7e2 with identifier: XH54291 to the API
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:11:51Z',
 'fuel_type': 'petrol',
 'id': '180d6918-580e-5525-bc26-88f3669db7e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH54291',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 242268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-18',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 DSi LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2006}
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH54291%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [auto1.it] INFO: Saving data for XH54291: {'auction_closing_time': 1774883511.0, 'created_time': 1774559113.188665, 'last_price_update_time': 1774861547.664776}
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XH54291') HTTP/1.1" 204 0
2026-03-30 09:05:47 [auto1.it] INFO: Found listing with ID: MX17045
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX17045%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [auto1.it] INFO: Scrape type for MX17045: 2
2026-03-30 09:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d52225f-afc4-5891-b123-b5356e57fc90 with identifier: MX17045
2026-03-30 09:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d52225f-afc4-5891-b123-b5356e57fc90 with scrape type 2
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d52225f-afc4-5891-b123-b5356e57fc90 with scrape type 2
2026-03-30 09:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d52225f-afc4-5891-b123-b5356e57fc90, identifier: MX17045
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_f1a5ada537096acd55a0f06aca5fce57.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_f1a5ada537096acd55a0f06aca5fce57.jpg not downloaded yet
2026-03-30 09:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_7ed0da886c023b2626b1b31e2225304a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:47 [auto1.it] INFO: Found listing with ID: MT29118
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT29118%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [auto1.it] INFO: Scrape type for MT29118: 2
2026-03-30 09:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 227dd677-1e76-52e1-9747-1b69ec8e4d92 with identifier: MT29118
2026-03-30 09:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 227dd677-1e76-52e1-9747-1b69ec8e4d92 with scrape type 2
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 227dd677-1e76-52e1-9747-1b69ec8e4d92 with scrape type 2
2026-03-30 09:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 227dd677-1e76-52e1-9747-1b69ec8e4d92, identifier: MT29118
2026-03-30 09:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d52225f-afc4-5891-b123-b5356e57fc90 with identifier: MX17045
2026-03-30 09:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d52225f-afc4-5891-b123-b5356e57fc90 with identifier: MX17045
2026-03-30 09:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d52225f-afc4-5891-b123-b5356e57fc90 with identifier: MX17045 to the API
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:08Z',
 'fuel_type': 'diesel',
 'id': '4d52225f-afc4-5891-b123-b5356e57fc90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX17045',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 126004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX17045%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [auto1.it] INFO: Saving data for MX17045: {'auction_closing_time': 1774884488.0, 'created_time': 1774774875.502002, 'last_price_update_time': 1774861548.253029}
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MX17045') HTTP/1.1" 204 0
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d06bf90>
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_6a1e42e29a4a8f89392118df4cb2be33.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_6a1e42e29a4a8f89392118df4cb2be33.jpg saved to cache
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e338fc77-6cf7-590d-b9fd-095d73f56551
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062cb550>
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Faa%252F60aa8059d29e116a6dc2ef9a670620de%252Fpa%252FFL99970_385f184d260a89d206ea90050547dfc0.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_385f184d260a89d206ea90050547dfc0.jpg saved to cache
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0aef16de-37ed-51fd-9a2d-02a471d48637
2026-03-30 09:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0aef16de-37ed-51fd-9a2d-02a471d48637, skipping ID generation
2026-03-30 09:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aef16de-37ed-51fd-9a2d-02a471d48637 with scrape type 1
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0aef16de-37ed-51fd-9a2d-02a471d48637 sending to next pipeline
2026-03-30 09:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0aef16de-37ed-51fd-9a2d-02a471d48637, identifier: FL99970
2026-03-30 09:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 227dd677-1e76-52e1-9747-1b69ec8e4d92 with identifier: MT29118
2026-03-30 09:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 227dd677-1e76-52e1-9747-1b69ec8e4d92 with identifier: MT29118
2026-03-30 09:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 227dd677-1e76-52e1-9747-1b69ec8e4d92 with identifier: MT29118 to the API
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:03:26Z',
 'fuel_type': 'petrol',
 'id': '227dd677-1e76-52e1-9747-1b69ec8e4d92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT29118',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 90119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-30',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2018}
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT29118%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [auto1.it] INFO: Saving data for MT29118: {'auction_closing_time': 1774883006.0, 'created_time': 1770974124.037326, 'last_price_update_time': 1774861548.808691}
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MT29118') HTTP/1.1" 204 0
2026-03-30 09:05:48 [auto1.it] INFO: Found listing with ID: VR64645
2026-03-30 09:05:48 [auto1.it] INFO: Found listing with ID: SN43822
2026-03-30 09:05:48 [auto1.it] INFO: Found listing with ID: SD56970
2026-03-30 09:05:48 [auto1.it] INFO: Found listing with ID: RA13201
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA13201%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [auto1.it] INFO: Scrape type for RA13201: 2
2026-03-30 09:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e7240b5-b0be-50c0-a8ad-2c565349fb54 with identifier: RA13201
2026-03-30 09:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7240b5-b0be-50c0-a8ad-2c565349fb54 with scrape type 2
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e7240b5-b0be-50c0-a8ad-2c565349fb54 with scrape type 2
2026-03-30 09:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e7240b5-b0be-50c0-a8ad-2c565349fb54, identifier: RA13201
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_3c03e660913a35f7538f0d8bf09c96a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_3c03e660913a35f7538f0d8bf09c96a3.jpg not downloaded yet
2026-03-30 09:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0aef16de-37ed-51fd-9a2d-02a471d48637 with identifier: FL99970
2026-03-30 09:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0aef16de-37ed-51fd-9a2d-02a471d48637 with identifier: FL99970
2026-03-30 09:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0aef16de-37ed-51fd-9a2d-02a471d48637 with identifier: FL99970 to the API
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_385f184d260a89d206ea90050547dfc0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:42:57Z',
 'fuel_type': 'diesel',
 'id': '0aef16de-37ed-51fd-9a2d-02a471d48637',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL99970',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 100005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_a1207de1b8bb876662071fa6d9ab974b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_7c101290c2f7696acd21e977cd46cd8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_104b6d8c5016de13769ab8ca0afe4a99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_fd6a4ab56ffc9ee43d91fa3b1bfa0ac2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_b242fa6ef9baeb490572fbf1c8c443ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_385f184d260a89d206ea90050547dfc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_9f8ccaa63bd6ba1e010b62fb30c2b356.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_e383ebfe8cf93c8f567e09094a58a3db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_f45d60bf2404ba3b2c79d8f844ebfa51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aef16de-37ed-51fd-9a2d-02a471d48637/0aef16de-37ed-51fd-9a2d-02a471d48637_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/aa/60aa8059d29e116a6dc2ef9a670620de/pa/FL99970_4d2a867ad06d68c8e4de3e8059976eb1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL99970%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [auto1.it] INFO: Saving data for FL99970: {'created_time': 1774861549.354983, 'last_price_update_time': 1774861549.354993, 'auction_closing_time': 1774971777.0}
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FL99970') HTTP/1.1" 204 0
2026-03-30 09:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_8ff7529962f3006a401a061977e1bfcb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:49 [auto1.it] INFO: Found listing with ID: DU49636
2026-03-30 09:05:49 [auto1.it] INFO: Found listing with ID: GE97185
2026-03-30 09:05:49 [auto1.it] INFO: Found listing with ID: TS11869
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS11869%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [auto1.it] INFO: Scrape type for TS11869: 2
2026-03-30 09:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53de055e-9546-5926-a70e-cd4196f61f0a with identifier: TS11869
2026-03-30 09:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53de055e-9546-5926-a70e-cd4196f61f0a with scrape type 2
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53de055e-9546-5926-a70e-cd4196f61f0a with scrape type 2
2026-03-30 09:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 53de055e-9546-5926-a70e-cd4196f61f0a, identifier: TS11869
2026-03-30 09:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e7240b5-b0be-50c0-a8ad-2c565349fb54 with identifier: RA13201
2026-03-30 09:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e7240b5-b0be-50c0-a8ad-2c565349fb54 with identifier: RA13201
2026-03-30 09:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6e7240b5-b0be-50c0-a8ad-2c565349fb54 with identifier: RA13201 to the API
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:10:12Z',
 'fuel_type': 'diesel',
 'id': '6e7240b5-b0be-50c0-a8ad-2c565349fb54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA13201',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 69868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA13201%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [auto1.it] INFO: Saving data for RA13201: {'auction_closing_time': 1774883412.0, 'created_time': 1774774883.573156, 'last_price_update_time': 1774861549.806906}
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA13201') HTTP/1.1" 204 0
2026-03-30 09:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c1d090>
2026-03-30 09:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_361bfbbc259ed246048fdf7a0839f4ff.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_361bfbbc259ed246048fdf7a0839f4ff.jpg saved to cache
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e338fc77-6cf7-590d-b9fd-095d73f56551
2026-03-30 09:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 53de055e-9546-5926-a70e-cd4196f61f0a with identifier: TS11869
2026-03-30 09:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 53de055e-9546-5926-a70e-cd4196f61f0a with identifier: TS11869
2026-03-30 09:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 53de055e-9546-5926-a70e-cd4196f61f0a with identifier: TS11869 to the API
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:01:54Z',
 'fuel_type': 'hybrid',
 'id': '53de055e-9546-5926-a70e-cd4196f61f0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS11869',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 56251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-24',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Exellence 2WD',
 'transmission': 'automatic',
 'trim': 'Exellence 2WD',
 'year': 2021}
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS11869%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [auto1.it] INFO: Saving data for TS11869: {'auction_closing_time': 1774882914.0, 'created_time': 1774774866.764301, 'last_price_update_time': 1774861550.145502}
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TS11869') HTTP/1.1" 204 0
2026-03-30 09:05:50 [auto1.it] INFO: Found listing with ID: CW79165
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW79165%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [auto1.it] INFO: Scrape type for CW79165: 2
2026-03-30 09:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94d63fb1-77d5-5ffb-a85a-d2f8ac0ce25b with identifier: CW79165
2026-03-30 09:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94d63fb1-77d5-5ffb-a85a-d2f8ac0ce25b with scrape type 2
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94d63fb1-77d5-5ffb-a85a-d2f8ac0ce25b with scrape type 2
2026-03-30 09:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 94d63fb1-77d5-5ffb-a85a-d2f8ac0ce25b, identifier: CW79165
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_ffc194ba15dce7028b07a333e16239fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_ffc194ba15dce7028b07a333e16239fe.jpg not downloaded yet
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0613aad0>
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_7ed0da886c023b2626b1b31e2225304a.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_7ed0da886c023b2626b1b31e2225304a.jpg saved to cache
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e338fc77-6cf7-590d-b9fd-095d73f56551
2026-03-30 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_18d763597cd1bca0b44b11aba20f49b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:50 [auto1.it] INFO: Found listing with ID: UJ50466
2026-03-30 09:05:50 [auto1.it] INFO: Found listing with ID: CM44345
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM44345%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [auto1.it] INFO: Scrape type for CM44345: 2
2026-03-30 09:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df961a42-9077-5a6d-8858-edcbb7ea8aac with identifier: CM44345
2026-03-30 09:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df961a42-9077-5a6d-8858-edcbb7ea8aac with scrape type 2
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df961a42-9077-5a6d-8858-edcbb7ea8aac with scrape type 2
2026-03-30 09:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: df961a42-9077-5a6d-8858-edcbb7ea8aac, identifier: CM44345
2026-03-30 09:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 94d63fb1-77d5-5ffb-a85a-d2f8ac0ce25b with identifier: CW79165
2026-03-30 09:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 94d63fb1-77d5-5ffb-a85a-d2f8ac0ce25b with identifier: CW79165
2026-03-30 09:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 94d63fb1-77d5-5ffb-a85a-d2f8ac0ce25b with identifier: CW79165 to the API
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:48:33Z',
 'fuel_type': 'diesel',
 'id': '94d63fb1-77d5-5ffb-a85a-d2f8ac0ce25b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW79165',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 234566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-10',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2008}
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW79165%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [auto1.it] INFO: Saving data for CW79165: {'auction_closing_time': 1774885713.0, 'created_time': 1771408946.273916, 'last_price_update_time': 1774861550.715327}
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CW79165') HTTP/1.1" 204 0
2026-03-30 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE22248/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK22038/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_d728cb75124227a1a18b53a97823c600.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: df961a42-9077-5a6d-8858-edcbb7ea8aac with identifier: CM44345
2026-03-30 09:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: df961a42-9077-5a6d-8858-edcbb7ea8aac with identifier: CM44345
2026-03-30 09:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: df961a42-9077-5a6d-8858-edcbb7ea8aac with identifier: CM44345 to the API
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:03:26Z',
 'fuel_type': 'petrol',
 'id': 'df961a42-9077-5a6d-8858-edcbb7ea8aac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM44345',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 257010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend/Zetec',
 'transmission': 'manual',
 'trim': 'Trend/Zetec',
 'year': 2004}
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM44345%27 HTTP/1.1" 200 None
2026-03-30 09:05:51 [auto1.it] INFO: Saving data for CM44345: {'auction_closing_time': 1774883006.0, 'created_time': 1774645692.595767, 'last_price_update_time': 1774861551.071776}
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CM44345') HTTP/1.1" 204 0
2026-03-30 09:05:51 [auto1.it] INFO: Found listing with ID: VT45573
2026-03-30 09:05:51 [auto1.it] INFO: Found listing with ID: DN35896
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN35896%27 HTTP/1.1" 200 None
2026-03-30 09:05:51 [auto1.it] INFO: Scrape type for DN35896: 2
2026-03-30 09:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c16d4e2b-6161-5bbe-a4a7-0330cb75760b with identifier: DN35896
2026-03-30 09:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c16d4e2b-6161-5bbe-a4a7-0330cb75760b with scrape type 2
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c16d4e2b-6161-5bbe-a4a7-0330cb75760b with scrape type 2
2026-03-30 09:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c16d4e2b-6161-5bbe-a4a7-0330cb75760b, identifier: DN35896
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_a480c3a77fa689fe79dd3b8c9b3d4bb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_a480c3a77fa689fe79dd3b8c9b3d4bb8.jpg not downloaded yet
2026-03-30 09:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET82005/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d069090>
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_8ff7529962f3006a401a061977e1bfcb.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_8ff7529962f3006a401a061977e1bfcb.jpg saved to cache
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71433cce-0dc4-5f0e-b958-980f9a360beb
2026-03-30 09:05:51 [auto1.it] INFO: Found listing with ID: DT89224
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT89224%27 HTTP/1.1" 200 None
2026-03-30 09:05:51 [auto1.it] INFO: Scrape type for DT89224: 2
2026-03-30 09:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d9272b3-d0ee-5093-a330-6dab10bee825 with identifier: DT89224
2026-03-30 09:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d9272b3-d0ee-5093-a330-6dab10bee825 with scrape type 2
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d9272b3-d0ee-5093-a330-6dab10bee825 with scrape type 2
2026-03-30 09:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3d9272b3-d0ee-5093-a330-6dab10bee825, identifier: DT89224
2026-03-30 09:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c16d4e2b-6161-5bbe-a4a7-0330cb75760b with identifier: DN35896
2026-03-30 09:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c16d4e2b-6161-5bbe-a4a7-0330cb75760b with identifier: DN35896
2026-03-30 09:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c16d4e2b-6161-5bbe-a4a7-0330cb75760b with identifier: DN35896 to the API
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:26Z',
 'fuel_type': 'diesel',
 'id': 'c16d4e2b-6161-5bbe-a4a7-0330cb75760b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN35896',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 66525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-29',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2020}
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN35896%27 HTTP/1.1" 200 None
2026-03-30 09:05:52 [auto1.it] INFO: Saving data for DN35896: {'auction_closing_time': 1774886186.0, 'created_time': 1774774875.17742, 'last_price_update_time': 1774861552.152181}
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DN35896') HTTP/1.1" 204 0
2026-03-30 09:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_f1a5ada537096acd55a0f06aca5fce57.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3d9272b3-d0ee-5093-a330-6dab10bee825 with identifier: DT89224
2026-03-30 09:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3d9272b3-d0ee-5093-a330-6dab10bee825 with identifier: DT89224
2026-03-30 09:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3d9272b3-d0ee-5093-a330-6dab10bee825 with identifier: DT89224 to the API
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:51:55Z',
 'fuel_type': 'diesel',
 'id': '3d9272b3-d0ee-5093-a330-6dab10bee825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT89224',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 58268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-30',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2020}
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT89224%27 HTTP/1.1" 200 None
2026-03-30 09:05:52 [auto1.it] INFO: Saving data for DT89224: {'auction_closing_time': 1774885915.0, 'created_time': 1773694970.034934, 'last_price_update_time': 1774861552.770242}
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DT89224') HTTP/1.1" 204 0
2026-03-30 09:05:52 [auto1.it] INFO: Found listing with ID: SH22668
2026-03-30 09:05:52 [auto1.it] INFO: Found listing with ID: ZN78264
2026-03-30 09:05:52 [auto1.it] INFO: Found listing with ID: LJ66160
2026-03-30 09:05:52 [auto1.it] INFO: Found listing with ID: YA14449
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA14449%27 HTTP/1.1" 200 None
2026-03-30 09:05:52 [auto1.it] INFO: Scrape type for YA14449: 2
2026-03-30 09:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 984fb4fe-6bfb-52b3-9846-a034f7183ef9 with identifier: YA14449
2026-03-30 09:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984fb4fe-6bfb-52b3-9846-a034f7183ef9 with scrape type 2
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 984fb4fe-6bfb-52b3-9846-a034f7183ef9 with scrape type 2
2026-03-30 09:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 984fb4fe-6bfb-52b3-9846-a034f7183ef9, identifier: YA14449
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_0822bdf3dd7b619b3c00f76cf709424e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_0822bdf3dd7b619b3c00f76cf709424e.jpg not downloaded yet
2026-03-30 09:05:53 [auto1.it] INFO: Found listing with ID: BT02963
2026-03-30 09:05:53 [auto1.it] INFO: Found listing with ID: RZ83260
2026-03-30 09:05:53 [auto1.it] INFO: Found listing with ID: TV98220
2026-03-30 09:05:53 [auto1.it] INFO: Found listing with ID: JT03788
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT03788%27 HTTP/1.1" 200 None
2026-03-30 09:05:53 [auto1.it] INFO: Scrape type for JT03788: 2
2026-03-30 09:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0928fed9-9f6b-5dde-af2f-8f99d5015f49 with identifier: JT03788
2026-03-30 09:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0928fed9-9f6b-5dde-af2f-8f99d5015f49 with scrape type 2
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0928fed9-9f6b-5dde-af2f-8f99d5015f49 with scrape type 2
2026-03-30 09:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0928fed9-9f6b-5dde-af2f-8f99d5015f49, identifier: JT03788
2026-03-30 09:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 984fb4fe-6bfb-52b3-9846-a034f7183ef9 with identifier: YA14449
2026-03-30 09:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 984fb4fe-6bfb-52b3-9846-a034f7183ef9 with identifier: YA14449
2026-03-30 09:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 984fb4fe-6bfb-52b3-9846-a034f7183ef9 with identifier: YA14449 to the API
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:56:45Z',
 'fuel_type': 'diesel',
 'id': '984fb4fe-6bfb-52b3-9846-a034f7183ef9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA14449',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 93334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d Sport Extra Edition',
 'transmission': 'automatic',
 'trim': 'Sport Extra Edition',
 'year': 2019}
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA14449%27 HTTP/1.1" 200 None
2026-03-30 09:05:53 [auto1.it] INFO: Saving data for YA14449: {'auction_closing_time': 1774886205.0, 'created_time': 1774774883.883967, 'last_price_update_time': 1774861553.552844}
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YA14449') HTTP/1.1" 204 0
2026-03-30 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH66131/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU84675/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06013310>
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F10%252F1610cd0bd648a24f3040aaad37031565%252Fpa%252FVP57623_18d763597cd1bca0b44b11aba20f49b7.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_18d763597cd1bca0b44b11aba20f49b7.jpg saved to cache
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e338fc77-6cf7-590d-b9fd-095d73f56551
2026-03-30 09:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e338fc77-6cf7-590d-b9fd-095d73f56551, skipping ID generation
2026-03-30 09:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e338fc77-6cf7-590d-b9fd-095d73f56551 with scrape type 1
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e338fc77-6cf7-590d-b9fd-095d73f56551 sending to next pipeline
2026-03-30 09:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e338fc77-6cf7-590d-b9fd-095d73f56551, identifier: VP57623
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06efa210>
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_d728cb75124227a1a18b53a97823c600.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_d728cb75124227a1a18b53a97823c600.jpg saved to cache
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71433cce-0dc4-5f0e-b958-980f9a360beb
2026-03-30 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_ffc194ba15dce7028b07a333e16239fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_3c03e660913a35f7538f0d8bf09c96a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0928fed9-9f6b-5dde-af2f-8f99d5015f49 with identifier: JT03788
2026-03-30 09:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0928fed9-9f6b-5dde-af2f-8f99d5015f49 with identifier: JT03788
2026-03-30 09:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0928fed9-9f6b-5dde-af2f-8f99d5015f49 with identifier: JT03788 to the API
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:35:49Z',
 'fuel_type': 'diesel',
 'id': '0928fed9-9f6b-5dde-af2f-8f99d5015f49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT03788',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 138456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Executive',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Executive',
 'year': 2014}
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT03788%27 HTTP/1.1" 200 None
2026-03-30 09:05:54 [auto1.it] INFO: Saving data for JT03788: {'auction_closing_time': 1774884949.0, 'created_time': 1774774872.602142, 'last_price_update_time': 1774861554.068223}
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JT03788') HTTP/1.1" 204 0
2026-03-30 09:05:54 [auto1.it] INFO: Found listing with ID: NV42122
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV42122%27 HTTP/1.1" 200 None
2026-03-30 09:05:54 [auto1.it] INFO: Scrape type for NV42122: 2
2026-03-30 09:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc6fc041-9485-5680-913d-f37d050a24e0 with identifier: NV42122
2026-03-30 09:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6fc041-9485-5680-913d-f37d050a24e0 with scrape type 2
2026-03-30 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc6fc041-9485-5680-913d-f37d050a24e0 with scrape type 2
2026-03-30 09:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dc6fc041-9485-5680-913d-f37d050a24e0, identifier: NV42122
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_9e5d3bb53513f3d51b64cb581393c728.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_9e5d3bb53513f3d51b64cb581393c728.jpg not downloaded yet
2026-03-30 09:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN04356> (referer: https://www.auto1.com/v1/car-details-view/WN04356/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ75115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e338fc77-6cf7-590d-b9fd-095d73f56551 with identifier: VP57623
2026-03-30 09:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e338fc77-6cf7-590d-b9fd-095d73f56551 with identifier: VP57623
2026-03-30 09:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e338fc77-6cf7-590d-b9fd-095d73f56551 with identifier: VP57623 to the API
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_18d763597cd1bca0b44b11aba20f49b7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:24:02Z',
 'fuel_type': 'diesel',
 'id': 'e338fc77-6cf7-590d-b9fd-095d73f56551',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP57623',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 172624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_dfe941985fc7098eb54772bb2ea58443.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_c44ebbdf789f65defe6d932ca4cbb47c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_7c378b19bb874bf2803fc22446be08ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_ef0b916bdc5582d4dd4c4a715be19c21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_2654cdfefe740e82257e099b2cedbfce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_7896aed36432887aa4fb907e3ba80e22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_6a1e42e29a4a8f89392118df4cb2be33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_361bfbbc259ed246048fdf7a0839f4ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_7ed0da886c023b2626b1b31e2225304a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e338fc77-6cf7-590d-b9fd-095d73f56551/e338fc77-6cf7-590d-b9fd-095d73f56551_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/10/1610cd0bd648a24f3040aaad37031565/pa/VP57623_18d763597cd1bca0b44b11aba20f49b7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi XPossible 4WD',
 'transmission': 'manual',
 'trim': 'XPossible 4WD',
 'year': 2015}
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP57623%27 HTTP/1.1" 200 None
2026-03-30 09:05:54 [auto1.it] INFO: Saving data for VP57623: {'created_time': 1774861554.575154, 'last_price_update_time': 1774861554.575164, 'auction_closing_time': 1774970642.0}
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VP57623') HTTP/1.1" 204 0
2026-03-30 09:05:54 [auto1.it] INFO: Found listing with ID: AT36089
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT36089%27 HTTP/1.1" 200 None
2026-03-30 09:05:54 [auto1.it] INFO: Scrape type for AT36089: 2
2026-03-30 09:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 475e8256-b9d1-56ae-adf3-3cc69d212585 with identifier: AT36089
2026-03-30 09:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 475e8256-b9d1-56ae-adf3-3cc69d212585 with scrape type 2
2026-03-30 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 475e8256-b9d1-56ae-adf3-3cc69d212585 with scrape type 2
2026-03-30 09:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 475e8256-b9d1-56ae-adf3-3cc69d212585, identifier: AT36089
2026-03-30 09:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dc6fc041-9485-5680-913d-f37d050a24e0 with identifier: NV42122
2026-03-30 09:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dc6fc041-9485-5680-913d-f37d050a24e0 with identifier: NV42122
2026-03-30 09:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dc6fc041-9485-5680-913d-f37d050a24e0 with identifier: NV42122 to the API
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-30T15:00:03Z',
 'fuel_type': 'hybrid',
 'id': 'dc6fc041-9485-5680-913d-f37d050a24e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV42122',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 38125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-30',
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2022}
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV42122%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [auto1.it] INFO: Saving data for NV42122: {'auction_closing_time': 1774882803.0, 'created_time': 1771532373.96451, 'last_price_update_time': 1774861555.037245}
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NV42122') HTTP/1.1" 204 0
2026-03-30 09:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH48340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0622fdd0>
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_f1a5ada537096acd55a0f06aca5fce57.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_f1a5ada537096acd55a0f06aca5fce57.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71433cce-0dc4-5f0e-b958-980f9a360beb
2026-03-30 09:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 475e8256-b9d1-56ae-adf3-3cc69d212585 with identifier: AT36089
2026-03-30 09:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 475e8256-b9d1-56ae-adf3-3cc69d212585 with identifier: AT36089
2026-03-30 09:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 475e8256-b9d1-56ae-adf3-3cc69d212585 with identifier: AT36089 to the API
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:53:46Z',
 'fuel_type': 'diesel',
 'id': '475e8256-b9d1-56ae-adf3-3cc69d212585',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT36089',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 152518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-28',
 'seller_name': None,
 'title': 'Land Rover Evoque D165 Mild-Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2021}
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT36089%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [auto1.it] INFO: Saving data for AT36089: {'auction_closing_time': 1774886026.0, 'created_time': 1774774884.209445, 'last_price_update_time': 1774861555.400276}
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AT36089') HTTP/1.1" 204 0
2026-03-30 09:05:55 [auto1.it] INFO: Found listing with ID: JZ43630
2026-03-30 09:05:55 [auto1.it] INFO: Found listing with ID: TT43912
2026-03-30 09:05:55 [auto1.it] INFO: Found listing with ID: AG55709
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG55709%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [auto1.it] INFO: Scrape type for AG55709: 2
2026-03-30 09:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 863829b2-ea4d-50c6-8ee2-277aa9750262 with identifier: AG55709
2026-03-30 09:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 863829b2-ea4d-50c6-8ee2-277aa9750262 with scrape type 2
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 863829b2-ea4d-50c6-8ee2-277aa9750262 with scrape type 2
2026-03-30 09:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 863829b2-ea4d-50c6-8ee2-277aa9750262, identifier: AG55709
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_99322ba90b206f9bcd25ddb1a4258687.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_99322ba90b206f9bcd25ddb1a4258687.jpg not downloaded yet
2026-03-30 09:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:55 [auto1.it] INFO: Found listing with ID: PZ95103
2026-03-30 09:05:55 [auto1.it] INFO: Found listing with ID: SR34135
2026-03-30 09:05:55 [auto1.it] INFO: Found listing with ID: XU47833
2026-03-30 09:05:55 [auto1.it] INFO: Found listing with ID: MH60635
2026-03-30 09:05:55 [auto1.it] INFO: Found listing with ID: VB43526
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB43526%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [auto1.it] INFO: Scrape type for VB43526: 2
2026-03-30 09:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58ec174d-ab15-5406-937b-234058614739 with identifier: VB43526
2026-03-30 09:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58ec174d-ab15-5406-937b-234058614739 with scrape type 2
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58ec174d-ab15-5406-937b-234058614739 with scrape type 2
2026-03-30 09:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 58ec174d-ab15-5406-937b-234058614739, identifier: VB43526
2026-03-30 09:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 863829b2-ea4d-50c6-8ee2-277aa9750262 with identifier: AG55709
2026-03-30 09:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 863829b2-ea4d-50c6-8ee2-277aa9750262 with identifier: AG55709
2026-03-30 09:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 863829b2-ea4d-50c6-8ee2-277aa9750262 with identifier: AG55709 to the API
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:35:27Z',
 'fuel_type': 'diesel',
 'id': '863829b2-ea4d-50c6-8ee2-277aa9750262',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG55709',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 83593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-03',
 'seller_name': None,
 'title': 'Jeep Renegade 2.0 M-Jet Limited 4WD',
 'transmission': 'manual',
 'trim': 'Limited 4WD',
 'year': 2019}
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG55709%27 HTTP/1.1" 200 None
2026-03-30 09:05:56 [auto1.it] INFO: Saving data for AG55709: {'auction_closing_time': 1774884927.0, 'created_time': 1774774875.862993, 'last_price_update_time': 1774861556.343516}
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AG55709') HTTP/1.1" 204 0
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0639f210>
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_ffc194ba15dce7028b07a333e16239fe.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_ffc194ba15dce7028b07a333e16239fe.jpg saved to cache
2026-03-30 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71433cce-0dc4-5f0e-b958-980f9a360beb
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062f1ed0>
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_3c03e660913a35f7538f0d8bf09c96a3.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_3c03e660913a35f7538f0d8bf09c96a3.jpg saved to cache
2026-03-30 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71433cce-0dc4-5f0e-b958-980f9a360beb
2026-03-30 09:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3dc9d78-c240-5bb5-94a4-f52affb3593c with identifier: WN04356
2026-03-30 09:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3dc9d78-c240-5bb5-94a4-f52affb3593c with scrape type 1
2026-03-30 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3dc9d78-c240-5bb5-94a4-f52affb3593c
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_8a7e40e2a43bffa0d1fd71bebf5cf114.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_8a7e40e2a43bffa0d1fd71bebf5cf114.jpg not downloaded yet
2026-03-30 09:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_0822bdf3dd7b619b3c00f76cf709424e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_a480c3a77fa689fe79dd3b8c9b3d4bb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 58ec174d-ab15-5406-937b-234058614739 with identifier: VB43526
2026-03-30 09:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 58ec174d-ab15-5406-937b-234058614739 with identifier: VB43526
2026-03-30 09:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 58ec174d-ab15-5406-937b-234058614739 with identifier: VB43526 to the API
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:31:09Z',
 'fuel_type': 'diesel',
 'id': '58ec174d-ab15-5406-937b-234058614739',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB43526',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 90009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-21',
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 BLUE dCi Sport Edition 2',
 'transmission': 'manual',
 'trim': 'Sport Edition 2',
 'year': 2020}
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB43526%27 HTTP/1.1" 200 None
2026-03-30 09:05:56 [auto1.it] INFO: Saving data for VB43526: {'auction_closing_time': 1774884669.0, 'created_time': 1773501457.03488, 'last_price_update_time': 1774861556.978881}
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VB43526') HTTP/1.1" 204 0
2026-03-30 09:05:56 [auto1.it] INFO: Found listing with ID: UZ37756
2026-03-30 09:05:57 [auto1.it] INFO: Found listing with ID: RW18979
2026-03-30 09:05:57 [auto1.it] INFO: Found listing with ID: UT39332
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT39332%27 HTTP/1.1" 200 None
2026-03-30 09:05:57 [auto1.it] INFO: Scrape type for UT39332: 2
2026-03-30 09:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31d5f646-0dbf-59e6-9586-40f05ebeecd1 with identifier: UT39332
2026-03-30 09:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31d5f646-0dbf-59e6-9586-40f05ebeecd1 with scrape type 2
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31d5f646-0dbf-59e6-9586-40f05ebeecd1 with scrape type 2
2026-03-30 09:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 31d5f646-0dbf-59e6-9586-40f05ebeecd1, identifier: UT39332
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_62530b2dab426ef38cadb2426360016a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_62530b2dab426ef38cadb2426360016a.jpg not downloaded yet
2026-03-30 09:05:57 [auto1.it] INFO: Found listing with ID: ZU21710
2026-03-30 09:05:57 [auto1.it] INFO: Found listing with ID: VU35787
2026-03-30 09:05:57 [auto1.it] INFO: Found listing with ID: JE99705
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE99705%27 HTTP/1.1" 200 None
2026-03-30 09:05:57 [auto1.it] INFO: Scrape type for JE99705: 2
2026-03-30 09:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c597c97-f8ee-5284-a831-7a94823b94bc with identifier: JE99705
2026-03-30 09:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c597c97-f8ee-5284-a831-7a94823b94bc with scrape type 2
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c597c97-f8ee-5284-a831-7a94823b94bc with scrape type 2
2026-03-30 09:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c597c97-f8ee-5284-a831-7a94823b94bc, identifier: JE99705
2026-03-30 09:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 31d5f646-0dbf-59e6-9586-40f05ebeecd1 with identifier: UT39332
2026-03-30 09:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 31d5f646-0dbf-59e6-9586-40f05ebeecd1 with identifier: UT39332
2026-03-30 09:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 31d5f646-0dbf-59e6-9586-40f05ebeecd1 with identifier: UT39332 to the API
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:23:22Z',
 'fuel_type': 'petrol',
 'id': '31d5f646-0dbf-59e6-9586-40f05ebeecd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT39332',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 43700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-02-13',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2001}
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT39332%27 HTTP/1.1" 200 None
2026-03-30 09:05:57 [auto1.it] INFO: Saving data for UT39332: {'auction_closing_time': 1774884202.0, 'created_time': 1774645493.890008, 'last_price_update_time': 1774861557.950968}
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UT39332') HTTP/1.1" 204 0
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_5f9246d47eee6da0d8bdc2e4c7c44832.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_5f9246d47eee6da0d8bdc2e4c7c44832.jpg not downloaded yet
2026-03-30 09:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c597c97-f8ee-5284-a831-7a94823b94bc with identifier: JE99705
2026-03-30 09:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c597c97-f8ee-5284-a831-7a94823b94bc with identifier: JE99705
2026-03-30 09:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c597c97-f8ee-5284-a831-7a94823b94bc with identifier: JE99705 to the API
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-30T15:15:37Z',
 'fuel_type': 'petrol',
 'id': '5c597c97-f8ee-5284-a831-7a94823b94bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE99705',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Atos',
 'odometer': 78832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-05-30',
 'seller_name': None,
 'title': 'Hyundai Atos 1.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2001}
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE99705%27 HTTP/1.1" 200 None
2026-03-30 09:05:58 [auto1.it] INFO: Saving data for JE99705: {'auction_closing_time': 1774883737.0, 'created_time': 1774645471.847669, 'last_price_update_time': 1774861558.354386}
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE99705') HTTP/1.1" 204 0
2026-03-30 09:05:58 [auto1.it] INFO: Found listing with ID: NF11774
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF11774%27 HTTP/1.1" 200 None
2026-03-30 09:05:58 [auto1.it] INFO: Scrape type for NF11774: 2
2026-03-30 09:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 291068ae-b145-51e4-b587-5ed56927d335 with identifier: NF11774
2026-03-30 09:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 291068ae-b145-51e4-b587-5ed56927d335 with scrape type 2
2026-03-30 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 291068ae-b145-51e4-b587-5ed56927d335 with scrape type 2
2026-03-30 09:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 291068ae-b145-51e4-b587-5ed56927d335, identifier: NF11774
2026-03-30 09:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_9e5d3bb53513f3d51b64cb581393c728.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 291068ae-b145-51e4-b587-5ed56927d335 with identifier: NF11774
2026-03-30 09:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 291068ae-b145-51e4-b587-5ed56927d335 with identifier: NF11774
2026-03-30 09:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 291068ae-b145-51e4-b587-5ed56927d335 with identifier: NF11774 to the API
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:20:32Z',
 'fuel_type': 'diesel',
 'id': '291068ae-b145-51e4-b587-5ed56927d335',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF11774',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 55571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-21',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Super 2WD',
 'transmission': 'automatic',
 'trim': 'Super 2WD',
 'year': 2017}
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF11774%27 HTTP/1.1" 200 None
2026-03-30 09:05:59 [auto1.it] INFO: Saving data for NF11774: {'auction_closing_time': 1774884032.0, 'created_time': 1774774881.407261, 'last_price_update_time': 1774861559.048351}
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF11774') HTTP/1.1" 204 0
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_1ab213f6d39b15063d230b5e7fe4d38a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_1ab213f6d39b15063d230b5e7fe4d38a.jpg not downloaded yet
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06da4350>
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_0822bdf3dd7b619b3c00f76cf709424e.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_0822bdf3dd7b619b3c00f76cf709424e.jpg saved to cache
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71433cce-0dc4-5f0e-b958-980f9a360beb
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cd0310>
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_a480c3a77fa689fe79dd3b8c9b3d4bb8.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_a480c3a77fa689fe79dd3b8c9b3d4bb8.jpg saved to cache
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71433cce-0dc4-5f0e-b958-980f9a360beb
2026-03-30 09:05:59 [auto1.it] INFO: Found listing with ID: HH94865
2026-03-30 09:05:59 [auto1.it] INFO: Found listing with ID: GV68046
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV68046%27 HTTP/1.1" 200 None
2026-03-30 09:05:59 [auto1.it] INFO: Scrape type for GV68046: 2
2026-03-30 09:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bb0fa41-e004-5209-8350-6b8ac44414fb with identifier: GV68046
2026-03-30 09:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bb0fa41-e004-5209-8350-6b8ac44414fb with scrape type 2
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bb0fa41-e004-5209-8350-6b8ac44414fb with scrape type 2
2026-03-30 09:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5bb0fa41-e004-5209-8350-6b8ac44414fb, identifier: GV68046
2026-03-30 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY38939> (referer: https://www.auto1.com/v1/car-details-view/CY38939/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY93977/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_99322ba90b206f9bcd25ddb1a4258687.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5bb0fa41-e004-5209-8350-6b8ac44414fb with identifier: GV68046
2026-03-30 09:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5bb0fa41-e004-5209-8350-6b8ac44414fb with identifier: GV68046
2026-03-30 09:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5bb0fa41-e004-5209-8350-6b8ac44414fb with identifier: GV68046 to the API
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:34:14Z',
 'fuel_type': 'petrol',
 'id': '5bb0fa41-e004-5209-8350-6b8ac44414fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV68046',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 38408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-27',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV68046%27 HTTP/1.1" 200 None
2026-03-30 09:05:59 [auto1.it] INFO: Saving data for GV68046: {'auction_closing_time': 1774884854.0, 'created_time': 1774774881.713457, 'last_price_update_time': 1774861559.637069}
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GV68046') HTTP/1.1" 204 0
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_5ebc93a60b70fdf93f2f3bc53c896395.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_5ebc93a60b70fdf93f2f3bc53c896395.jpg not downloaded yet
2026-03-30 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_8a7e40e2a43bffa0d1fd71bebf5cf114.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:59 [auto1.it] INFO: Found listing with ID: AM83523
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM83523%27 HTTP/1.1" 200 None
2026-03-30 09:05:59 [auto1.it] INFO: Scrape type for AM83523: 2
2026-03-30 09:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffbb08d7-9c42-5115-9fe3-1abe7add63aa with identifier: AM83523
2026-03-30 09:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffbb08d7-9c42-5115-9fe3-1abe7add63aa with scrape type 2
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffbb08d7-9c42-5115-9fe3-1abe7add63aa with scrape type 2
2026-03-30 09:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ffbb08d7-9c42-5115-9fe3-1abe7add63aa, identifier: AM83523
2026-03-30 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06391010>
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_9e5d3bb53513f3d51b64cb581393c728.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_9e5d3bb53513f3d51b64cb581393c728.jpg saved to cache
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71433cce-0dc4-5f0e-b958-980f9a360beb
2026-03-30 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_62530b2dab426ef38cadb2426360016a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ffbb08d7-9c42-5115-9fe3-1abe7add63aa with identifier: AM83523
2026-03-30 09:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ffbb08d7-9c42-5115-9fe3-1abe7add63aa with identifier: AM83523
2026-03-30 09:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ffbb08d7-9c42-5115-9fe3-1abe7add63aa with identifier: AM83523 to the API
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-30T15:00:21Z',
 'fuel_type': 'hybrid',
 'id': 'ffbb08d7-9c42-5115-9fe3-1abe7add63aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM83523',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'RX-Serie',
 'odometer': 111479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-02',
 'seller_name': None,
 'title': 'Lexus RX-Serie RX 450h Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2009}
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM83523%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [auto1.it] INFO: Saving data for AM83523: {'auction_closing_time': 1774882821.0, 'created_time': 1774774884.966201, 'last_price_update_time': 1774861560.157674}
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AM83523') HTTP/1.1" 204 0
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_e3ab770b6a9ceb4bdfbcbf5208b36dd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_e3ab770b6a9ceb4bdfbcbf5208b36dd7.jpg not downloaded yet
2026-03-30 09:06:00 [auto1.it] INFO: Found listing with ID: PL36367
2026-03-30 09:06:00 [auto1.it] INFO: Found listing with ID: FD72326
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD72326%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [auto1.it] INFO: Scrape type for FD72326: 2
2026-03-30 09:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c118efc7-24f4-5465-823d-4d3fd86cfb7c with identifier: FD72326
2026-03-30 09:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c118efc7-24f4-5465-823d-4d3fd86cfb7c with scrape type 2
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c118efc7-24f4-5465-823d-4d3fd86cfb7c with scrape type 2
2026-03-30 09:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c118efc7-24f4-5465-823d-4d3fd86cfb7c, identifier: FD72326
2026-03-30 09:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5b303da-8a41-5368-b91b-5d0846dc1416 with identifier: CY38939
2026-03-30 09:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5b303da-8a41-5368-b91b-5d0846dc1416 with scrape type 1
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5b303da-8a41-5368-b91b-5d0846dc1416
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f2864d7ba25592e7e4ecefa9617122b%252Fpa%252FCY38939_9ed3ab9b23b4a8d5fbb5b7f919ea07dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_9ed3ab9b23b4a8d5fbb5b7f919ea07dc.jpg already downloaded
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f2864d7ba25592e7e4ecefa9617122b%252Fpa%252FCY38939_24f74ac1e3c31f307d74d4b4bd4c4fe2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_24f74ac1e3c31f307d74d4b4bd4c4fe2.jpg already downloaded
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f2864d7ba25592e7e4ecefa9617122b%252Fpa%252FCY38939_9ddcfd04635a17607dcfc41855c5d551.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_9ddcfd04635a17607dcfc41855c5d551.jpg already downloaded
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f2864d7ba25592e7e4ecefa9617122b%252Fpa%252FCY38939_38d09df6afef2408bcce47f0fe1f18e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_38d09df6afef2408bcce47f0fe1f18e8.jpg already downloaded
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f2864d7ba25592e7e4ecefa9617122b%252Fpa%252FCY38939_0340b9294d6e170bae9afc3b3c7dec47.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_0340b9294d6e170bae9afc3b3c7dec47.jpg already downloaded
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f2864d7ba25592e7e4ecefa9617122b%252Fpa%252FCY38939_c7de79d7a2ce0cf20247953fe1feb879.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_c7de79d7a2ce0cf20247953fe1feb879.jpg already downloaded
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f2864d7ba25592e7e4ecefa9617122b%252Fpa%252FCY38939_b26abf0d97e9e85c1b2cbbf9a2716b7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_b26abf0d97e9e85c1b2cbbf9a2716b7b.jpg already downloaded
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f2864d7ba25592e7e4ecefa9617122b%252Fpa%252FCY38939_e7f0c665ead89062f93c519bad01a59c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_e7f0c665ead89062f93c519bad01a59c.jpg already downloaded
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f2864d7ba25592e7e4ecefa9617122b%252Fpa%252FCY38939_a57f2fce84ce98135734d5f904c2d686.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_a57f2fce84ce98135734d5f904c2d686.jpg already downloaded
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f2864d7ba25592e7e4ecefa9617122b%252Fpa%252FCY38939_e5f55a64eb40cec5d2de8dd79aee0e65.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_e5f55a64eb40cec5d2de8dd79aee0e65.jpg already downloaded
2026-03-30 09:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e5b303da-8a41-5368-b91b-5d0846dc1416, identifier: CY38939
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d30490>
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_99322ba90b206f9bcd25ddb1a4258687.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_99322ba90b206f9bcd25ddb1a4258687.jpg saved to cache
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71433cce-0dc4-5f0e-b958-980f9a360beb
2026-03-30 09:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c118efc7-24f4-5465-823d-4d3fd86cfb7c with identifier: FD72326
2026-03-30 09:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c118efc7-24f4-5465-823d-4d3fd86cfb7c with identifier: FD72326
2026-03-30 09:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c118efc7-24f4-5465-823d-4d3fd86cfb7c with identifier: FD72326 to the API
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:40:42Z',
 'fuel_type': 'petrol',
 'id': 'c118efc7-24f4-5465-823d-4d3fd86cfb7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD72326',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 165313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-29',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.6 Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2005}
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD72326%27 HTTP/1.1" 200 None
2026-03-30 09:06:01 [auto1.it] INFO: Saving data for FD72326: {'auction_closing_time': 1774885242.0, 'created_time': 1773404988.879634, 'last_price_update_time': 1774861561.015824}
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FD72326') HTTP/1.1" 204 0
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_edfe73446bb4d45f8f5da1e8619a20e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_edfe73446bb4d45f8f5da1e8619a20e4.jpg not downloaded yet
2026-03-30 09:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e5b303da-8a41-5368-b91b-5d0846dc1416 with identifier: CY38939
2026-03-30 09:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e5b303da-8a41-5368-b91b-5d0846dc1416 with identifier: CY38939
2026-03-30 09:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e5b303da-8a41-5368-b91b-5d0846dc1416 with identifier: CY38939 to the API
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CY38939>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:54:17Z',
 'fuel_type': 'diesel',
 'id': 'e5b303da-8a41-5368-b91b-5d0846dc1416',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY38939',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 24542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_9ed3ab9b23b4a8d5fbb5b7f919ea07dc.jpg',
                'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_24f74ac1e3c31f307d74d4b4bd4c4fe2.jpg',
                'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_9ddcfd04635a17607dcfc41855c5d551.jpg',
                'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_38d09df6afef2408bcce47f0fe1f18e8.jpg',
                'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_0340b9294d6e170bae9afc3b3c7dec47.jpg',
                'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_c7de79d7a2ce0cf20247953fe1feb879.jpg',
                'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_b26abf0d97e9e85c1b2cbbf9a2716b7b.jpg',
                'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_e7f0c665ead89062f93c519bad01a59c.jpg',
                'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_a57f2fce84ce98135734d5f904c2d686.jpg',
                'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_e5f55a64eb40cec5d2de8dd79aee0e65.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b303da-8a41-5368-b91b-5d0846dc1416/e5b303da-8a41-5368-b91b-5d0846dc1416_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_9ed3ab9b23b4a8d5fbb5b7f919ea07dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b303da-8a41-5368-b91b-5d0846dc1416/e5b303da-8a41-5368-b91b-5d0846dc1416_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_24f74ac1e3c31f307d74d4b4bd4c4fe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b303da-8a41-5368-b91b-5d0846dc1416/e5b303da-8a41-5368-b91b-5d0846dc1416_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_9ddcfd04635a17607dcfc41855c5d551.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b303da-8a41-5368-b91b-5d0846dc1416/e5b303da-8a41-5368-b91b-5d0846dc1416_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_38d09df6afef2408bcce47f0fe1f18e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b303da-8a41-5368-b91b-5d0846dc1416/e5b303da-8a41-5368-b91b-5d0846dc1416_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_0340b9294d6e170bae9afc3b3c7dec47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b303da-8a41-5368-b91b-5d0846dc1416/e5b303da-8a41-5368-b91b-5d0846dc1416_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_c7de79d7a2ce0cf20247953fe1feb879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b303da-8a41-5368-b91b-5d0846dc1416/e5b303da-8a41-5368-b91b-5d0846dc1416_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_b26abf0d97e9e85c1b2cbbf9a2716b7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b303da-8a41-5368-b91b-5d0846dc1416/e5b303da-8a41-5368-b91b-5d0846dc1416_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_e7f0c665ead89062f93c519bad01a59c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b303da-8a41-5368-b91b-5d0846dc1416/e5b303da-8a41-5368-b91b-5d0846dc1416_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_a57f2fce84ce98135734d5f904c2d686.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b303da-8a41-5368-b91b-5d0846dc1416/e5b303da-8a41-5368-b91b-5d0846dc1416_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f2864d7ba25592e7e4ecefa9617122b/pa/CY38939_e5f55a64eb40cec5d2de8dd79aee0e65.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2024}
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY38939%27 HTTP/1.1" 200 None
2026-03-30 09:06:01 [auto1.it] INFO: Saving data for CY38939: {'created_time': 1774861561.478467, 'last_price_update_time': 1774861561.478483, 'auction_closing_time': 1774972457.0}
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CY38939') HTTP/1.1" 204 0
2026-03-30 09:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_1ab213f6d39b15063d230b5e7fe4d38a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_5f9246d47eee6da0d8bdc2e4c7c44832.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:01 [auto1.it] INFO: Found listing with ID: EZ36845
2026-03-30 09:06:01 [auto1.it] INFO: Found listing with ID: ES96291
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES96291%27 HTTP/1.1" 200 None
2026-03-30 09:06:01 [auto1.it] INFO: Scrape type for ES96291: 2
2026-03-30 09:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 614f982d-cf60-55ff-9e81-c6d77ade6586 with identifier: ES96291
2026-03-30 09:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 614f982d-cf60-55ff-9e81-c6d77ade6586 with scrape type 2
2026-03-30 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 614f982d-cf60-55ff-9e81-c6d77ade6586 with scrape type 2
2026-03-30 09:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 614f982d-cf60-55ff-9e81-c6d77ade6586, identifier: ES96291
2026-03-30 09:06:01 [auto1.it] INFO: Channel: 24h | Page: 25 | totalHits: 3304 | hits on page: 40
2026-03-30 09:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06107090>
2026-03-30 09:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_8a7e40e2a43bffa0d1fd71bebf5cf114.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_8a7e40e2a43bffa0d1fd71bebf5cf114.jpg saved to cache
2026-03-30 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3dc9d78-c240-5bb5-94a4-f52affb3593c
2026-03-30 09:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0622ff50>
2026-03-30 09:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F3e%252F623ec2b5667807687117668e05f1330e%252Fpa%252FRV29599_62530b2dab426ef38cadb2426360016a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_62530b2dab426ef38cadb2426360016a.jpg saved to cache
2026-03-30 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71433cce-0dc4-5f0e-b958-980f9a360beb
2026-03-30 09:06:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71433cce-0dc4-5f0e-b958-980f9a360beb, skipping ID generation
2026-03-30 09:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71433cce-0dc4-5f0e-b958-980f9a360beb with scrape type 1
2026-03-30 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71433cce-0dc4-5f0e-b958-980f9a360beb sending to next pipeline
2026-03-30 09:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 71433cce-0dc4-5f0e-b958-980f9a360beb, identifier: RV29599
2026-03-30 09:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 614f982d-cf60-55ff-9e81-c6d77ade6586 with identifier: ES96291
2026-03-30 09:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 614f982d-cf60-55ff-9e81-c6d77ade6586 with identifier: ES96291
2026-03-30 09:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 614f982d-cf60-55ff-9e81-c6d77ade6586 with identifier: ES96291 to the API
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:10:10Z',
 'fuel_type': 'petrol',
 'id': '614f982d-cf60-55ff-9e81-c6d77ade6586',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES96291',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 46926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2021}
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES96291%27 HTTP/1.1" 200 None
2026-03-30 09:06:02 [auto1.it] INFO: Saving data for ES96291: {'auction_closing_time': 1774883410.0, 'created_time': 1774774892.936963, 'last_price_update_time': 1774861562.108443}
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ES96291') HTTP/1.1" 204 0
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_5a7d2112ee3b107dd6b5a488e04295e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_5a7d2112ee3b107dd6b5a488e04295e5.jpg not downloaded yet
2026-03-30 09:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 71433cce-0dc4-5f0e-b958-980f9a360beb with identifier: RV29599
2026-03-30 09:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 71433cce-0dc4-5f0e-b958-980f9a360beb with identifier: RV29599
2026-03-30 09:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 71433cce-0dc4-5f0e-b958-980f9a360beb with identifier: RV29599 to the API
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_62530b2dab426ef38cadb2426360016a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:58:42Z',
 'fuel_type': 'petrol',
 'id': '71433cce-0dc4-5f0e-b958-980f9a360beb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV29599',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 44254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_8ff7529962f3006a401a061977e1bfcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_d728cb75124227a1a18b53a97823c600.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_f1a5ada537096acd55a0f06aca5fce57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_3c03e660913a35f7538f0d8bf09c96a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_ffc194ba15dce7028b07a333e16239fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_a480c3a77fa689fe79dd3b8c9b3d4bb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_0822bdf3dd7b619b3c00f76cf709424e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_9e5d3bb53513f3d51b64cb581393c728.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_99322ba90b206f9bcd25ddb1a4258687.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71433cce-0dc4-5f0e-b958-980f9a360beb/71433cce-0dc4-5f0e-b958-980f9a360beb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/3e/623ec2b5667807687117668e05f1330e/pa/RV29599_62530b2dab426ef38cadb2426360016a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2015}
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV29599%27 HTTP/1.1" 200 None
2026-03-30 09:06:03 [auto1.it] INFO: Saving data for RV29599: {'created_time': 1774861563.103709, 'last_price_update_time': 1774861563.103722, 'auction_closing_time': 1774972722.0}
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RV29599') HTTP/1.1" 204 0
2026-03-30 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_5ebc93a60b70fdf93f2f3bc53c896395.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:03 [auto1.it] INFO: Found listing with ID: DJ07683
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ07683%27 HTTP/1.1" 200 None
2026-03-30 09:06:03 [auto1.it] INFO: Scrape type for DJ07683: 2
2026-03-30 09:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a5b513e-d390-511c-b631-993b48f39b9a with identifier: DJ07683
2026-03-30 09:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a5b513e-d390-511c-b631-993b48f39b9a with scrape type 2
2026-03-30 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a5b513e-d390-511c-b631-993b48f39b9a with scrape type 2
2026-03-30 09:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a5b513e-d390-511c-b631-993b48f39b9a, identifier: DJ07683
2026-03-30 09:06:03 [auto1.it] INFO: Found listing with ID: DX48884
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX48884%27 HTTP/1.1" 200 None
2026-03-30 09:06:03 [auto1.it] INFO: Scrape type for DX48884: 2
2026-03-30 09:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10015f3c-b976-5b55-879e-eeefd2c1e6c3 with identifier: DX48884
2026-03-30 09:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10015f3c-b976-5b55-879e-eeefd2c1e6c3 with scrape type 2
2026-03-30 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10015f3c-b976-5b55-879e-eeefd2c1e6c3 with scrape type 2
2026-03-30 09:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 10015f3c-b976-5b55-879e-eeefd2c1e6c3, identifier: DX48884
2026-03-30 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_e3ab770b6a9ceb4bdfbcbf5208b36dd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a5b513e-d390-511c-b631-993b48f39b9a with identifier: DJ07683
2026-03-30 09:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a5b513e-d390-511c-b631-993b48f39b9a with identifier: DJ07683
2026-03-30 09:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a5b513e-d390-511c-b631-993b48f39b9a with identifier: DJ07683 to the API
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:41:25Z',
 'fuel_type': 'petrol',
 'id': '7a5b513e-d390-511c-b631-993b48f39b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ07683',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C2',
 'odometer': 199297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-31',
 'seller_name': None,
 'title': 'Citroen C2 1.1 VSX',
 'transmission': 'manual',
 'trim': 'VSX',
 'year': 2006}
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ07683%27 HTTP/1.1" 200 None
2026-03-30 09:06:03 [auto1.it] INFO: Saving data for DJ07683: {'auction_closing_time': 1774885285.0, 'created_time': 1774559133.149571, 'last_price_update_time': 1774861563.665838}
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DJ07683') HTTP/1.1" 204 0
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_316f4306308c478bb468d4c4330a6d87.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_316f4306308c478bb468d4c4330a6d87.jpg not downloaded yet
2026-03-30 09:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 10015f3c-b976-5b55-879e-eeefd2c1e6c3 with identifier: DX48884
2026-03-30 09:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 10015f3c-b976-5b55-879e-eeefd2c1e6c3 with identifier: DX48884
2026-03-30 09:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 10015f3c-b976-5b55-879e-eeefd2c1e6c3 with identifier: DX48884 to the API
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:24:56Z',
 'fuel_type': 'petrol',
 'id': '10015f3c-b976-5b55-879e-eeefd2c1e6c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX48884',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 144039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-30',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2006}
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX48884%27 HTTP/1.1" 200 None
2026-03-30 09:06:03 [auto1.it] INFO: Saving data for DX48884: {'auction_closing_time': 1774884296.0, 'created_time': 1774559100.246422, 'last_price_update_time': 1774861563.965924}
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DX48884') HTTP/1.1" 204 0
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c669d0>
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_1ab213f6d39b15063d230b5e7fe4d38a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_1ab213f6d39b15063d230b5e7fe4d38a.jpg saved to cache
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3dc9d78-c240-5bb5-94a4-f52affb3593c
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06367b50>
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_5f9246d47eee6da0d8bdc2e4c7c44832.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_5f9246d47eee6da0d8bdc2e4c7c44832.jpg saved to cache
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3dc9d78-c240-5bb5-94a4-f52affb3593c
2026-03-30 09:06:04 [scrapy.extensions.logstats] INFO: Crawled 248 pages (at 33 pages/min), scraped 441 items (at 96 items/min)
2026-03-30 09:06:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 198MiB
2026-03-30 09:06:04 [auto1.it] INFO: Found listing with ID: ZU40989
2026-03-30 09:06:04 [auto1.it] INFO: Found listing with ID: DM38646
2026-03-30 09:06:04 [auto1.it] INFO: Found listing with ID: YA96352
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA96352%27 HTTP/1.1" 200 None
2026-03-30 09:06:04 [auto1.it] INFO: Scrape type for YA96352: 2
2026-03-30 09:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69d3f82e-a3dc-5b95-a7eb-3c0868d62e6f with identifier: YA96352
2026-03-30 09:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69d3f82e-a3dc-5b95-a7eb-3c0868d62e6f with scrape type 2
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69d3f82e-a3dc-5b95-a7eb-3c0868d62e6f with scrape type 2
2026-03-30 09:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 69d3f82e-a3dc-5b95-a7eb-3c0868d62e6f, identifier: YA96352
2026-03-30 09:06:04 [auto1.it] INFO: Found listing with ID: GJ25727
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ25727%27 HTTP/1.1" 200 None
2026-03-30 09:06:04 [auto1.it] INFO: Scrape type for GJ25727: 2
2026-03-30 09:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: befda80b-4c25-58b0-9eb7-4c3e7b423fbc with identifier: GJ25727
2026-03-30 09:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item befda80b-4c25-58b0-9eb7-4c3e7b423fbc with scrape type 2
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item befda80b-4c25-58b0-9eb7-4c3e7b423fbc with scrape type 2
2026-03-30 09:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: befda80b-4c25-58b0-9eb7-4c3e7b423fbc, identifier: GJ25727
2026-03-30 09:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB25673> (referer: https://www.auto1.com/v1/car-details-view/GB25673/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK22038> (referer: https://www.auto1.com/v1/car-details-view/AK22038/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE22248> (referer: https://www.auto1.com/v1/car-details-view/JE22248/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR67041> (referer: https://www.auto1.com/v1/car-details-view/UR67041/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF81077> (referer: https://www.auto1.com/v1/car-details-view/RF81077/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 69d3f82e-a3dc-5b95-a7eb-3c0868d62e6f with identifier: YA96352
2026-03-30 09:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 69d3f82e-a3dc-5b95-a7eb-3c0868d62e6f with identifier: YA96352
2026-03-30 09:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 69d3f82e-a3dc-5b95-a7eb-3c0868d62e6f with identifier: YA96352 to the API
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:59:40Z',
 'fuel_type': 'diesel',
 'id': '69d3f82e-a3dc-5b95-a7eb-3c0868d62e6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA96352',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 110132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-11',
 'seller_name': None,
 'title': 'Jaguar F-Pace D200 Mild-Hybrid R-Dynamic HSE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE AWD',
 'year': 2021}
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA96352%27 HTTP/1.1" 200 None
2026-03-30 09:06:04 [auto1.it] INFO: Saving data for YA96352: {'auction_closing_time': 1774886380.0, 'created_time': 1773694962.357924, 'last_price_update_time': 1774861564.691318}
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YA96352') HTTP/1.1" 204 0
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_f0d2d3abc1b2f71d59f45111706f2906.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_f0d2d3abc1b2f71d59f45111706f2906.jpg not downloaded yet
2026-03-30 09:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: befda80b-4c25-58b0-9eb7-4c3e7b423fbc with identifier: GJ25727
2026-03-30 09:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: befda80b-4c25-58b0-9eb7-4c3e7b423fbc with identifier: GJ25727
2026-03-30 09:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: befda80b-4c25-58b0-9eb7-4c3e7b423fbc with identifier: GJ25727 to the API
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:00Z',
 'fuel_type': 'diesel',
 'id': 'befda80b-4c25-58b0-9eb7-4c3e7b423fbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ25727',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 219263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2004}
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ25727%27 HTTP/1.1" 200 None
2026-03-30 09:06:05 [auto1.it] INFO: Saving data for GJ25727: {'auction_closing_time': 1774883700.0, 'created_time': 1773268020.165011, 'last_price_update_time': 1774861565.027364}
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GJ25727') HTTP/1.1" 204 0
2026-03-30 09:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0628fdd0>
2026-03-30 09:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_5ebc93a60b70fdf93f2f3bc53c896395.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_5ebc93a60b70fdf93f2f3bc53c896395.jpg saved to cache
2026-03-30 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3dc9d78-c240-5bb5-94a4-f52affb3593c
2026-03-30 09:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_edfe73446bb4d45f8f5da1e8619a20e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:05 [auto1.it] INFO: Found listing with ID: NJ11800
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ11800%27 HTTP/1.1" 200 None
2026-03-30 09:06:05 [auto1.it] INFO: Scrape type for NJ11800: 2
2026-03-30 09:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49e07c9e-fbd7-5ef8-b5cf-d4dedba04ba7 with identifier: NJ11800
2026-03-30 09:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49e07c9e-fbd7-5ef8-b5cf-d4dedba04ba7 with scrape type 2
2026-03-30 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49e07c9e-fbd7-5ef8-b5cf-d4dedba04ba7 with scrape type 2
2026-03-30 09:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49e07c9e-fbd7-5ef8-b5cf-d4dedba04ba7, identifier: NJ11800
2026-03-30 09:06:05 [auto1.it] INFO: Found listing with ID: EM71095
2026-03-30 09:06:05 [auto1.it] INFO: Found listing with ID: BU87588
2026-03-30 09:06:05 [auto1.it] INFO: Found listing with ID: CS73145
2026-03-30 09:06:05 [auto1.it] INFO: Found listing with ID: PF00609
2026-03-30 09:06:05 [auto1.it] INFO: Found listing with ID: VJ94912
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ94912%27 HTTP/1.1" 200 None
2026-03-30 09:06:05 [auto1.it] INFO: Scrape type for VJ94912: 2
2026-03-30 09:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d00ced43-e514-5699-b1eb-91afb6ade84c with identifier: VJ94912
2026-03-30 09:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d00ced43-e514-5699-b1eb-91afb6ade84c with scrape type 2
2026-03-30 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d00ced43-e514-5699-b1eb-91afb6ade84c with scrape type 2
2026-03-30 09:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d00ced43-e514-5699-b1eb-91afb6ade84c, identifier: VJ94912
2026-03-30 09:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061a77d0>
2026-03-30 09:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_e3ab770b6a9ceb4bdfbcbf5208b36dd7.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_e3ab770b6a9ceb4bdfbcbf5208b36dd7.jpg saved to cache
2026-03-30 09:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3dc9d78-c240-5bb5-94a4-f52affb3593c
2026-03-30 09:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_5a7d2112ee3b107dd6b5a488e04295e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49e07c9e-fbd7-5ef8-b5cf-d4dedba04ba7 with identifier: NJ11800
2026-03-30 09:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49e07c9e-fbd7-5ef8-b5cf-d4dedba04ba7 with identifier: NJ11800
2026-03-30 09:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49e07c9e-fbd7-5ef8-b5cf-d4dedba04ba7 with identifier: NJ11800 to the API
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:46:48Z',
 'fuel_type': 'petrol',
 'id': '49e07c9e-fbd7-5ef8-b5cf-d4dedba04ba7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ11800',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 231995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-06',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ11800%27 HTTP/1.1" 200 None
2026-03-30 09:06:05 [auto1.it] INFO: Saving data for NJ11800: {'auction_closing_time': 1774885608.0, 'created_time': 1774645505.416544, 'last_price_update_time': 1774861565.904295}
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NJ11800') HTTP/1.1" 204 0
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_24d3ebc51a1da0d822d509f0c613181e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_24d3ebc51a1da0d822d509f0c613181e.jpg not downloaded yet
2026-03-30 09:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d00ced43-e514-5699-b1eb-91afb6ade84c with identifier: VJ94912
2026-03-30 09:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d00ced43-e514-5699-b1eb-91afb6ade84c with identifier: VJ94912
2026-03-30 09:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d00ced43-e514-5699-b1eb-91afb6ade84c with identifier: VJ94912 to the API
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 309,
 'expiration_date': '2026-03-30T15:23:39Z',
 'fuel_type': 'hybrid',
 'id': 'd00ced43-e514-5699-b1eb-91afb6ade84c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ94912',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 106134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': None,
 'title': 'Land Rover Evoque P300e Hybrid R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2020}
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ94912%27 HTTP/1.1" 200 None
2026-03-30 09:06:06 [auto1.it] INFO: Saving data for VJ94912: {'auction_closing_time': 1774884219.0, 'created_time': 1774774888.989517, 'last_price_update_time': 1774861566.592461}
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VJ94912') HTTP/1.1" 204 0
2026-03-30 09:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU84675> (referer: https://www.auto1.com/v1/car-details-view/KU84675/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET82005> (referer: https://www.auto1.com/v1/car-details-view/ET82005/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:06 [auto1.it] INFO: Found listing with ID: EA59370
2026-03-30 09:06:06 [auto1.it] INFO: Found listing with ID: MD00417
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD00417%27 HTTP/1.1" 200 None
2026-03-30 09:06:06 [auto1.it] INFO: Scrape type for MD00417: 2
2026-03-30 09:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f893cc05-5672-557f-b292-f8b2d3e9c5f5 with identifier: MD00417
2026-03-30 09:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f893cc05-5672-557f-b292-f8b2d3e9c5f5 with scrape type 2
2026-03-30 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f893cc05-5672-557f-b292-f8b2d3e9c5f5 with scrape type 2
2026-03-30 09:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f893cc05-5672-557f-b292-f8b2d3e9c5f5, identifier: MD00417
2026-03-30 09:06:06 [auto1.it] INFO: Found listing with ID: MU64340
2026-03-30 09:06:06 [auto1.it] INFO: Found listing with ID: TU34163
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU34163%27 HTTP/1.1" 200 None
2026-03-30 09:06:06 [auto1.it] INFO: Scrape type for TU34163: 2
2026-03-30 09:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3d133ca-e3de-53d0-b500-b3210c7c44db with identifier: TU34163
2026-03-30 09:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3d133ca-e3de-53d0-b500-b3210c7c44db with scrape type 2
2026-03-30 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3d133ca-e3de-53d0-b500-b3210c7c44db with scrape type 2
2026-03-30 09:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3d133ca-e3de-53d0-b500-b3210c7c44db, identifier: TU34163
2026-03-30 09:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH66131> (referer: https://www.auto1.com/v1/car-details-view/YH66131/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddcac860-7a61-5840-890d-89de144cfa06 with identifier: GB25673
2026-03-30 09:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddcac860-7a61-5840-890d-89de144cfa06 with scrape type 1
2026-03-30 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ddcac860-7a61-5840-890d-89de144cfa06
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc2%252Fa1c2cb2a26fd768cf6c41e2ea0df23c7%252Fpa%252FGB25673_aa3c00def5654945c4d27c9bb4aea769.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_aa3c00def5654945c4d27c9bb4aea769.jpg already downloaded
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc2%252Fa1c2cb2a26fd768cf6c41e2ea0df23c7%252Fpa%252FGB25673_c56a1b3d5288d1be424369016421dd05.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_c56a1b3d5288d1be424369016421dd05.jpg already downloaded
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc2%252Fa1c2cb2a26fd768cf6c41e2ea0df23c7%252Fpa%252FGB25673_1d3dfec8eb8e121582e4b058f1677453.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_1d3dfec8eb8e121582e4b058f1677453.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc2%252Fa1c2cb2a26fd768cf6c41e2ea0df23c7%252Fpa%252FGB25673_86f24e9b255932b192498ea7db4ab23a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_86f24e9b255932b192498ea7db4ab23a.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc2%252Fa1c2cb2a26fd768cf6c41e2ea0df23c7%252Fpa%252FGB25673_8cc9ae32a3b8dcb826632ba7653c7fd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_8cc9ae32a3b8dcb826632ba7653c7fd6.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc2%252Fa1c2cb2a26fd768cf6c41e2ea0df23c7%252Fpa%252FGB25673_164fd847d95d2ef619cf82f1aa6a09c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_164fd847d95d2ef619cf82f1aa6a09c8.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc2%252Fa1c2cb2a26fd768cf6c41e2ea0df23c7%252Fpa%252FGB25673_aa8d31ad3c24ee6e1060626cc575e248.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_aa8d31ad3c24ee6e1060626cc575e248.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc2%252Fa1c2cb2a26fd768cf6c41e2ea0df23c7%252Fpa%252FGB25673_7ebe76082262f18e11a5928df4a70aac.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_7ebe76082262f18e11a5928df4a70aac.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc2%252Fa1c2cb2a26fd768cf6c41e2ea0df23c7%252Fpa%252FGB25673_b1998cdfe982eb306d516f7bb1aed06b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_b1998cdfe982eb306d516f7bb1aed06b.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc2%252Fa1c2cb2a26fd768cf6c41e2ea0df23c7%252Fpa%252FGB25673_58fc0fbcb146f13b2b52ed8a7347687b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_58fc0fbcb146f13b2b52ed8a7347687b.jpg already downloaded
2026-03-30 09:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ddcac860-7a61-5840-890d-89de144cfa06, identifier: GB25673
2026-03-30 09:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26 with identifier: AK22038
2026-03-30 09:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26 with scrape type 1
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F43%252Fef43bbdab50eb0b3d310b43d888a53eb%252Fpa%252FAK22038_d44bb210448e46b8ac49e144b6c3307c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_d44bb210448e46b8ac49e144b6c3307c.jpg not downloaded yet
2026-03-30 09:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dd53b5c-d892-5a26-a949-a9ad1dd25117 with identifier: JE22248
2026-03-30 09:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dd53b5c-d892-5a26-a949-a9ad1dd25117 with scrape type 1
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1dd53b5c-d892-5a26-a949-a9ad1dd25117
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fe8%252Fb6e829791d7dcac4639b16e5cd2d9530%252Fpa%252FJE22248_c14d7eb72f1848d4f47f7f7b9e7ceac5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_c14d7eb72f1848d4f47f7f7b9e7ceac5.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fe8%252Fb6e829791d7dcac4639b16e5cd2d9530%252Fpa%252FJE22248_0d14dae003bc1da9b061f10c4c6d328c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_0d14dae003bc1da9b061f10c4c6d328c.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fe8%252Fb6e829791d7dcac4639b16e5cd2d9530%252Fpa%252FJE22248_543990a3b126c1503abb1e16ef4b2929.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_543990a3b126c1503abb1e16ef4b2929.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fe8%252Fb6e829791d7dcac4639b16e5cd2d9530%252Fpa%252FJE22248_a93f89c5d17c18bb2a6f9e2991517ac4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_a93f89c5d17c18bb2a6f9e2991517ac4.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fe8%252Fb6e829791d7dcac4639b16e5cd2d9530%252Fpa%252FJE22248_c68815b37f75d0e93d03f5e00dcb3b3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_c68815b37f75d0e93d03f5e00dcb3b3a.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fe8%252Fb6e829791d7dcac4639b16e5cd2d9530%252Fpa%252FJE22248_82b64506df8e3bed96de9ca983352d39.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_82b64506df8e3bed96de9ca983352d39.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fe8%252Fb6e829791d7dcac4639b16e5cd2d9530%252Fpa%252FJE22248_613d595a5483362f409282647fa05c1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_613d595a5483362f409282647fa05c1f.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fe8%252Fb6e829791d7dcac4639b16e5cd2d9530%252Fpa%252FJE22248_cdfb18020586f3d50543e61dc7aedf71.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_cdfb18020586f3d50543e61dc7aedf71.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fe8%252Fb6e829791d7dcac4639b16e5cd2d9530%252Fpa%252FJE22248_c9e03ca9882546883f5bb5a4795ccc12.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_c9e03ca9882546883f5bb5a4795ccc12.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fe8%252Fb6e829791d7dcac4639b16e5cd2d9530%252Fpa%252FJE22248_cb081c36784511b0be3b4d6613853118.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_cb081c36784511b0be3b4d6613853118.jpg already downloaded
2026-03-30 09:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1dd53b5c-d892-5a26-a949-a9ad1dd25117, identifier: JE22248
2026-03-30 09:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8 with identifier: UR67041
2026-03-30 09:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8 with scrape type 1
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_96c12a32cca9a7921142fff09ca333d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_96c12a32cca9a7921142fff09ca333d2.jpg not downloaded yet
2026-03-30 09:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a016c1af-bb06-5016-a33b-c92c74e69c21 with identifier: RF81077
2026-03-30 09:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a016c1af-bb06-5016-a33b-c92c74e69c21 with scrape type 1
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a016c1af-bb06-5016-a33b-c92c74e69c21
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fc1%252Fcec1a96d6ea01f49b9a68d60253bf845%252Fpa%252FRF81077_27a88543b29bc6499204af58409505af.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_27a88543b29bc6499204af58409505af.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fc1%252Fcec1a96d6ea01f49b9a68d60253bf845%252Fpa%252FRF81077_dbd446be516bcbcc447d83ac13961a54.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_dbd446be516bcbcc447d83ac13961a54.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fc1%252Fcec1a96d6ea01f49b9a68d60253bf845%252Fpa%252FRF81077_b367b818398d6fe77eaa24145eae1286.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_b367b818398d6fe77eaa24145eae1286.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fc1%252Fcec1a96d6ea01f49b9a68d60253bf845%252Fpa%252FRF81077_eee6ee580a93cb448179ca22819d8c82.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_eee6ee580a93cb448179ca22819d8c82.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fc1%252Fcec1a96d6ea01f49b9a68d60253bf845%252Fpa%252FRF81077_dee0f9b46e376df121ebbdf878776b2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_dee0f9b46e376df121ebbdf878776b2b.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fc1%252Fcec1a96d6ea01f49b9a68d60253bf845%252Fpa%252FRF81077_f82b02d8bb83c2835cdb8e293486acc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_f82b02d8bb83c2835cdb8e293486acc5.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fc1%252Fcec1a96d6ea01f49b9a68d60253bf845%252Fpa%252FRF81077_8a7a9429d72f3935f937434c1377d5dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_8a7a9429d72f3935f937434c1377d5dc.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fc1%252Fcec1a96d6ea01f49b9a68d60253bf845%252Fpa%252FRF81077_20095ef1008491d47a21155f0b085ad9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_20095ef1008491d47a21155f0b085ad9.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fc1%252Fcec1a96d6ea01f49b9a68d60253bf845%252Fpa%252FRF81077_afdabe828ce938a40ee38d8952e2c071.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_afdabe828ce938a40ee38d8952e2c071.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fc1%252Fcec1a96d6ea01f49b9a68d60253bf845%252Fpa%252FRF81077_f5c9a6b2d42ad7967fd2ea86d4f47bd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_f5c9a6b2d42ad7967fd2ea86d4f47bd6.jpg already downloaded
2026-03-30 09:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a016c1af-bb06-5016-a33b-c92c74e69c21, identifier: RF81077
2026-03-30 09:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f893cc05-5672-557f-b292-f8b2d3e9c5f5 with identifier: MD00417
2026-03-30 09:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f893cc05-5672-557f-b292-f8b2d3e9c5f5 with identifier: MD00417
2026-03-30 09:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f893cc05-5672-557f-b292-f8b2d3e9c5f5 with identifier: MD00417 to the API
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:00:59Z',
 'fuel_type': 'diesel',
 'id': 'f893cc05-5672-557f-b292-f8b2d3e9c5f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD00417',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 193622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-10',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI quattro Ambition',
 'transmission': 'automatic',
 'trim': 'quattro Ambition',
 'year': 2016}
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD00417%27 HTTP/1.1" 200 None
2026-03-30 09:06:08 [auto1.it] INFO: Saving data for MD00417: {'auction_closing_time': 1774882859.0, 'created_time': 1772654851.825381, 'last_price_update_time': 1774861568.463831}
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MD00417') HTTP/1.1" 204 0
2026-03-30 09:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3d133ca-e3de-53d0-b500-b3210c7c44db with identifier: TU34163
2026-03-30 09:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3d133ca-e3de-53d0-b500-b3210c7c44db with identifier: TU34163
2026-03-30 09:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3d133ca-e3de-53d0-b500-b3210c7c44db with identifier: TU34163 to the API
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:53:44Z',
 'fuel_type': 'diesel',
 'id': 'e3d133ca-e3de-53d0-b500-b3210c7c44db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU34163',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 270595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-31',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.9 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2004}
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU34163%27 HTTP/1.1" 200 None
2026-03-30 09:06:08 [auto1.it] INFO: Saving data for TU34163: {'auction_closing_time': 1774886024.0, 'created_time': 1772748500.069827, 'last_price_update_time': 1774861568.811529}
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TU34163') HTTP/1.1" 204 0
2026-03-30 09:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ddcac860-7a61-5840-890d-89de144cfa06 with identifier: GB25673
2026-03-30 09:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ddcac860-7a61-5840-890d-89de144cfa06 with identifier: GB25673
2026-03-30 09:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ddcac860-7a61-5840-890d-89de144cfa06 with identifier: GB25673 to the API
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GB25673>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:18:12Z',
 'fuel_type': 'diesel',
 'id': 'ddcac860-7a61-5840-890d-89de144cfa06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB25673',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'BMW',
 'model': '6er',
 'odometer': 198790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_aa3c00def5654945c4d27c9bb4aea769.jpg',
                'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_c56a1b3d5288d1be424369016421dd05.jpg',
                'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_1d3dfec8eb8e121582e4b058f1677453.jpg',
                'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_86f24e9b255932b192498ea7db4ab23a.jpg',
                'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_8cc9ae32a3b8dcb826632ba7653c7fd6.jpg',
                'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_164fd847d95d2ef619cf82f1aa6a09c8.jpg',
                'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_aa8d31ad3c24ee6e1060626cc575e248.jpg',
                'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_7ebe76082262f18e11a5928df4a70aac.jpg',
                'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_b1998cdfe982eb306d516f7bb1aed06b.jpg',
                'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_58fc0fbcb146f13b2b52ed8a7347687b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcac860-7a61-5840-890d-89de144cfa06/ddcac860-7a61-5840-890d-89de144cfa06_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_aa3c00def5654945c4d27c9bb4aea769.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcac860-7a61-5840-890d-89de144cfa06/ddcac860-7a61-5840-890d-89de144cfa06_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_c56a1b3d5288d1be424369016421dd05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcac860-7a61-5840-890d-89de144cfa06/ddcac860-7a61-5840-890d-89de144cfa06_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_1d3dfec8eb8e121582e4b058f1677453.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcac860-7a61-5840-890d-89de144cfa06/ddcac860-7a61-5840-890d-89de144cfa06_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_86f24e9b255932b192498ea7db4ab23a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcac860-7a61-5840-890d-89de144cfa06/ddcac860-7a61-5840-890d-89de144cfa06_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_8cc9ae32a3b8dcb826632ba7653c7fd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcac860-7a61-5840-890d-89de144cfa06/ddcac860-7a61-5840-890d-89de144cfa06_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_164fd847d95d2ef619cf82f1aa6a09c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcac860-7a61-5840-890d-89de144cfa06/ddcac860-7a61-5840-890d-89de144cfa06_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_aa8d31ad3c24ee6e1060626cc575e248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcac860-7a61-5840-890d-89de144cfa06/ddcac860-7a61-5840-890d-89de144cfa06_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_7ebe76082262f18e11a5928df4a70aac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcac860-7a61-5840-890d-89de144cfa06/ddcac860-7a61-5840-890d-89de144cfa06_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_b1998cdfe982eb306d516f7bb1aed06b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcac860-7a61-5840-890d-89de144cfa06/ddcac860-7a61-5840-890d-89de144cfa06_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c2/a1c2cb2a26fd768cf6c41e2ea0df23c7/pa/GB25673_58fc0fbcb146f13b2b52ed8a7347687b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 6er 630d GT xDrive Luxury Line',
 'transmission': 'automatic',
 'trim': 'xDrive Luxury Line',
 'year': 2019}
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB25673%27 HTTP/1.1" 200 None
2026-03-30 09:06:09 [auto1.it] INFO: Saving data for GB25673: {'created_time': 1774861569.189588, 'last_price_update_time': 1774861569.189598, 'auction_closing_time': 1774970292.0}
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GB25673') HTTP/1.1" 204 0
2026-03-30 09:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1dd53b5c-d892-5a26-a949-a9ad1dd25117 with identifier: JE22248
2026-03-30 09:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1dd53b5c-d892-5a26-a949-a9ad1dd25117 with identifier: JE22248
2026-03-30 09:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1dd53b5c-d892-5a26-a949-a9ad1dd25117 with identifier: JE22248 to the API
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JE22248>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': 'Rental',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:25:43Z',
 'fuel_type': 'diesel',
 'id': '1dd53b5c-d892-5a26-a949-a9ad1dd25117',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE22248',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 270920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_c14d7eb72f1848d4f47f7f7b9e7ceac5.jpg',
                'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_0d14dae003bc1da9b061f10c4c6d328c.jpg',
                'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_543990a3b126c1503abb1e16ef4b2929.jpg',
                'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_a93f89c5d17c18bb2a6f9e2991517ac4.jpg',
                'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_c68815b37f75d0e93d03f5e00dcb3b3a.jpg',
                'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_82b64506df8e3bed96de9ca983352d39.jpg',
                'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_613d595a5483362f409282647fa05c1f.jpg',
                'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_cdfb18020586f3d50543e61dc7aedf71.jpg',
                'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_c9e03ca9882546883f5bb5a4795ccc12.jpg',
                'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_cb081c36784511b0be3b4d6613853118.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dd53b5c-d892-5a26-a949-a9ad1dd25117/1dd53b5c-d892-5a26-a949-a9ad1dd25117_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_c14d7eb72f1848d4f47f7f7b9e7ceac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dd53b5c-d892-5a26-a949-a9ad1dd25117/1dd53b5c-d892-5a26-a949-a9ad1dd25117_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2152631,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_0d14dae003bc1da9b061f10c4c6d328c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dd53b5c-d892-5a26-a949-a9ad1dd25117/1dd53b5c-d892-5a26-a949-a9ad1dd25117_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2070297,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_543990a3b126c1503abb1e16ef4b2929.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dd53b5c-d892-5a26-a949-a9ad1dd25117/1dd53b5c-d892-5a26-a949-a9ad1dd25117_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2131093,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_a93f89c5d17c18bb2a6f9e2991517ac4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dd53b5c-d892-5a26-a949-a9ad1dd25117/1dd53b5c-d892-5a26-a949-a9ad1dd25117_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_c68815b37f75d0e93d03f5e00dcb3b3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dd53b5c-d892-5a26-a949-a9ad1dd25117/1dd53b5c-d892-5a26-a949-a9ad1dd25117_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1999415,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_82b64506df8e3bed96de9ca983352d39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dd53b5c-d892-5a26-a949-a9ad1dd25117/1dd53b5c-d892-5a26-a949-a9ad1dd25117_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2005734,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_613d595a5483362f409282647fa05c1f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dd53b5c-d892-5a26-a949-a9ad1dd25117/1dd53b5c-d892-5a26-a949-a9ad1dd25117_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2003453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_cdfb18020586f3d50543e61dc7aedf71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dd53b5c-d892-5a26-a949-a9ad1dd25117/1dd53b5c-d892-5a26-a949-a9ad1dd25117_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_c9e03ca9882546883f5bb5a4795ccc12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dd53b5c-d892-5a26-a949-a9ad1dd25117/1dd53b5c-d892-5a26-a949-a9ad1dd25117_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/e8/b6e829791d7dcac4639b16e5cd2d9530/pa/JE22248_cb081c36784511b0be3b4d6613853118.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Business Line BlueMotion Tech.',
 'transmission': 'automatic',
 'trim': 'Business Line BlueMotion Tech.',
 'year': 2015}
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE22248%27 HTTP/1.1" 200 None
2026-03-30 09:06:09 [auto1.it] INFO: Saving data for JE22248: {'created_time': 1774861569.562428, 'last_price_update_time': 1774861569.562438, 'auction_closing_time': 1774970743.0}
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE22248') HTTP/1.1" 204 0
2026-03-30 09:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a016c1af-bb06-5016-a33b-c92c74e69c21 with identifier: RF81077
2026-03-30 09:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a016c1af-bb06-5016-a33b-c92c74e69c21 with identifier: RF81077
2026-03-30 09:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a016c1af-bb06-5016-a33b-c92c74e69c21 with identifier: RF81077 to the API
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RF81077>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:17:29Z',
 'fuel_type': 'petrol',
 'id': 'a016c1af-bb06-5016-a33b-c92c74e69c21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF81077',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 94253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_27a88543b29bc6499204af58409505af.jpg',
                'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_dbd446be516bcbcc447d83ac13961a54.jpg',
                'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_b367b818398d6fe77eaa24145eae1286.jpg',
                'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_eee6ee580a93cb448179ca22819d8c82.jpg',
                'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_dee0f9b46e376df121ebbdf878776b2b.jpg',
                'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_f82b02d8bb83c2835cdb8e293486acc5.jpg',
                'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_8a7a9429d72f3935f937434c1377d5dc.jpg',
                'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_20095ef1008491d47a21155f0b085ad9.jpg',
                'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_afdabe828ce938a40ee38d8952e2c071.jpg',
                'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_f5c9a6b2d42ad7967fd2ea86d4f47bd6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a016c1af-bb06-5016-a33b-c92c74e69c21/a016c1af-bb06-5016-a33b-c92c74e69c21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_27a88543b29bc6499204af58409505af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a016c1af-bb06-5016-a33b-c92c74e69c21/a016c1af-bb06-5016-a33b-c92c74e69c21_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_dbd446be516bcbcc447d83ac13961a54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a016c1af-bb06-5016-a33b-c92c74e69c21/a016c1af-bb06-5016-a33b-c92c74e69c21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_b367b818398d6fe77eaa24145eae1286.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a016c1af-bb06-5016-a33b-c92c74e69c21/a016c1af-bb06-5016-a33b-c92c74e69c21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_eee6ee580a93cb448179ca22819d8c82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a016c1af-bb06-5016-a33b-c92c74e69c21/a016c1af-bb06-5016-a33b-c92c74e69c21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_dee0f9b46e376df121ebbdf878776b2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a016c1af-bb06-5016-a33b-c92c74e69c21/a016c1af-bb06-5016-a33b-c92c74e69c21_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_f82b02d8bb83c2835cdb8e293486acc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a016c1af-bb06-5016-a33b-c92c74e69c21/a016c1af-bb06-5016-a33b-c92c74e69c21_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_8a7a9429d72f3935f937434c1377d5dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a016c1af-bb06-5016-a33b-c92c74e69c21/a016c1af-bb06-5016-a33b-c92c74e69c21_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_20095ef1008491d47a21155f0b085ad9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a016c1af-bb06-5016-a33b-c92c74e69c21/a016c1af-bb06-5016-a33b-c92c74e69c21_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_afdabe828ce938a40ee38d8952e2c071.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a016c1af-bb06-5016-a33b-c92c74e69c21/a016c1af-bb06-5016-a33b-c92c74e69c21_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/c1/cec1a96d6ea01f49b9a68d60253bf845/pa/RF81077_f5c9a6b2d42ad7967fd2ea86d4f47bd6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Oro',
 'transmission': 'manual',
 'trim': 'Oro',
 'year': 2011}
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF81077%27 HTTP/1.1" 200 None
2026-03-30 09:06:10 [auto1.it] INFO: Saving data for RF81077: {'created_time': 1774861570.189003, 'last_price_update_time': 1774861570.189014, 'auction_closing_time': 1774970249.0}
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF81077') HTTP/1.1" 204 0
2026-03-30 09:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_316f4306308c478bb468d4c4330a6d87.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:10 [auto1.it] INFO: Found listing with ID: NK45302
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK45302%27 HTTP/1.1" 200 None
2026-03-30 09:06:10 [auto1.it] INFO: Scrape type for NK45302: 2
2026-03-30 09:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b53d309-490f-55fc-b94a-6197b1b7f6a4 with identifier: NK45302
2026-03-30 09:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b53d309-490f-55fc-b94a-6197b1b7f6a4 with scrape type 2
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b53d309-490f-55fc-b94a-6197b1b7f6a4 with scrape type 2
2026-03-30 09:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b53d309-490f-55fc-b94a-6197b1b7f6a4, identifier: NK45302
2026-03-30 09:06:10 [auto1.it] INFO: Found listing with ID: ZV32235
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV32235%27 HTTP/1.1" 200 None
2026-03-30 09:06:10 [auto1.it] INFO: Scrape type for ZV32235: 2
2026-03-30 09:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ed42c94-01c5-5301-a827-742980fa9939 with identifier: ZV32235
2026-03-30 09:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ed42c94-01c5-5301-a827-742980fa9939 with scrape type 2
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ed42c94-01c5-5301-a827-742980fa9939 with scrape type 2
2026-03-30 09:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ed42c94-01c5-5301-a827-742980fa9939, identifier: ZV32235
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F43%252Fef43bbdab50eb0b3d310b43d888a53eb%252Fpa%252FAK22038_8f6be120a361a150df154b8de6c33096.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_8f6be120a361a150df154b8de6c33096.jpg not downloaded yet
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_d0db4572b863bf1d90d2da665e200423.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_d0db4572b863bf1d90d2da665e200423.jpg not downloaded yet
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d53e10>
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_edfe73446bb4d45f8f5da1e8619a20e4.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_edfe73446bb4d45f8f5da1e8619a20e4.jpg saved to cache
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3dc9d78-c240-5bb5-94a4-f52affb3593c
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0cdb8a90>
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_5a7d2112ee3b107dd6b5a488e04295e5.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_5a7d2112ee3b107dd6b5a488e04295e5.jpg saved to cache
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3dc9d78-c240-5bb5-94a4-f52affb3593c
2026-03-30 09:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b53d309-490f-55fc-b94a-6197b1b7f6a4 with identifier: NK45302
2026-03-30 09:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b53d309-490f-55fc-b94a-6197b1b7f6a4 with identifier: NK45302
2026-03-30 09:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b53d309-490f-55fc-b94a-6197b1b7f6a4 with identifier: NK45302 to the API
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:08:51Z',
 'fuel_type': 'diesel',
 'id': '3b53d309-490f-55fc-b94a-6197b1b7f6a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK45302',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 91775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-13',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d lang 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'lang 4Matic Avantgarde',
 'year': 2019}
2026-03-30 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK45302%27 HTTP/1.1" 200 None
2026-03-30 09:06:11 [auto1.it] INFO: Saving data for NK45302: {'auction_closing_time': 1774883331.0, 'created_time': 1774774916.702403, 'last_price_update_time': 1774861571.936141}
2026-03-30 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NK45302') HTTP/1.1" 204 0
2026-03-30 09:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ed42c94-01c5-5301-a827-742980fa9939 with identifier: ZV32235
2026-03-30 09:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ed42c94-01c5-5301-a827-742980fa9939 with identifier: ZV32235
2026-03-30 09:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ed42c94-01c5-5301-a827-742980fa9939 with identifier: ZV32235 to the API
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:53:13Z',
 'fuel_type': 'diesel',
 'id': '6ed42c94-01c5-5301-a827-742980fa9939',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV32235',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 162453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-28',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Executive Q4',
 'transmission': 'automatic',
 'trim': 'Executive Q4',
 'year': 2018}
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV32235%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [auto1.it] INFO: Saving data for ZV32235: {'auction_closing_time': 1774885993.0, 'created_time': 1774774889.309372, 'last_price_update_time': 1774861572.905597}
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZV32235') HTTP/1.1" 204 0
2026-03-30 09:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ddedd1e-0af2-5907-ae91-178525b040c0 with identifier: KU84675
2026-03-30 09:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ddedd1e-0af2-5907-ae91-178525b040c0 with scrape type 1
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ddedd1e-0af2-5907-ae91-178525b040c0
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_6772475beade01fe8eca195a7e5afd15.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_6772475beade01fe8eca195a7e5afd15.jpg not downloaded yet
2026-03-30 09:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a92a8841-4506-572a-b43e-dc02d7306fd8 with identifier: ET82005
2026-03-30 09:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a92a8841-4506-572a-b43e-dc02d7306fd8 with scrape type 1
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a92a8841-4506-572a-b43e-dc02d7306fd8
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_e9a9cb07030b6801c6381d9cd26a832a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_e9a9cb07030b6801c6381d9cd26a832a.jpg not downloaded yet
2026-03-30 09:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcd88757-87e2-5f42-b40a-3051825e0992 with identifier: YH66131
2026-03-30 09:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcd88757-87e2-5f42-b40a-3051825e0992 with scrape type 1
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcd88757-87e2-5f42-b40a-3051825e0992
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_c2e003f9d51e61b466b8f12b24418dd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_c2e003f9d51e61b466b8f12b24418dd0.jpg not downloaded yet
2026-03-30 09:06:13 [auto1.it] INFO: Found listing with ID: LE83357
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE83357%27 HTTP/1.1" 200 None
2026-03-30 09:06:13 [auto1.it] INFO: Scrape type for LE83357: 2
2026-03-30 09:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4752777c-c6c6-5a34-990f-cd04ff62a6b1 with identifier: LE83357
2026-03-30 09:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4752777c-c6c6-5a34-990f-cd04ff62a6b1 with scrape type 2
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4752777c-c6c6-5a34-990f-cd04ff62a6b1 with scrape type 2
2026-03-30 09:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4752777c-c6c6-5a34-990f-cd04ff62a6b1, identifier: LE83357
2026-03-30 09:06:13 [auto1.it] INFO: Found listing with ID: LA78712
2026-03-30 09:06:13 [auto1.it] INFO: Found listing with ID: UU36082
2026-03-30 09:06:13 [auto1.it] INFO: Found listing with ID: TZ72536
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ72536%27 HTTP/1.1" 200 None
2026-03-30 09:06:13 [auto1.it] INFO: Scrape type for TZ72536: 2
2026-03-30 09:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe288607-30f4-5e8e-a2c0-4df93b5dda84 with identifier: TZ72536
2026-03-30 09:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe288607-30f4-5e8e-a2c0-4df93b5dda84 with scrape type 2
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe288607-30f4-5e8e-a2c0-4df93b5dda84 with scrape type 2
2026-03-30 09:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fe288607-30f4-5e8e-a2c0-4df93b5dda84, identifier: TZ72536
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F43%252Fef43bbdab50eb0b3d310b43d888a53eb%252Fpa%252FAK22038_a4a109a92187872eac846f2b029a1edf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_a4a109a92187872eac846f2b029a1edf.jpg not downloaded yet
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_639488f2de7e071417b22aa3ef5266f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_639488f2de7e071417b22aa3ef5266f6.jpg not downloaded yet
2026-03-30 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_f0d2d3abc1b2f71d59f45111706f2906.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4752777c-c6c6-5a34-990f-cd04ff62a6b1 with identifier: LE83357
2026-03-30 09:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4752777c-c6c6-5a34-990f-cd04ff62a6b1 with identifier: LE83357
2026-03-30 09:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4752777c-c6c6-5a34-990f-cd04ff62a6b1 with identifier: LE83357 to the API
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-30T15:26:26Z',
 'fuel_type': 'petrol',
 'id': '4752777c-c6c6-5a34-990f-cd04ff62a6b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE83357',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 29503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-18',
 'seller_name': None,
 'title': 'Suzuki SX4 1.4 DITC Mild-Hybrid S-Cross Cool 2WD',
 'transmission': 'manual',
 'trim': 'S-Cross Cool 2WD',
 'year': 2021}
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE83357%27 HTTP/1.1" 200 None
2026-03-30 09:06:13 [auto1.it] INFO: Saving data for LE83357: {'auction_closing_time': 1774884386.0, 'created_time': 1773749280.132906, 'last_price_update_time': 1774861573.591429}
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LE83357') HTTP/1.1" 204 0
2026-03-30 09:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fe288607-30f4-5e8e-a2c0-4df93b5dda84 with identifier: TZ72536
2026-03-30 09:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fe288607-30f4-5e8e-a2c0-4df93b5dda84 with identifier: TZ72536
2026-03-30 09:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fe288607-30f4-5e8e-a2c0-4df93b5dda84 with identifier: TZ72536 to the API
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:34:59Z',
 'fuel_type': 'diesel',
 'id': 'fe288607-30f4-5e8e-a2c0-4df93b5dda84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ72536',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 208843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-04-25',
 'seller_name': None,
 'title': 'Opel Zafira 2.0 DTI Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2002}
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ72536%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [auto1.it] INFO: Saving data for TZ72536: {'auction_closing_time': 1774884899.0, 'created_time': 1773131810.644212, 'last_price_update_time': 1774861574.398597}
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TZ72536') HTTP/1.1" 204 0
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_cf03e0ff3bf6028cb9909aab28758248.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_cf03e0ff3bf6028cb9909aab28758248.jpg not downloaded yet
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_c50438b79cb07ae02c65e070a1582e71.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_c50438b79cb07ae02c65e070a1582e71.jpg not downloaded yet
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_a69131abaae5277b8f73b87f8d5f7224.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_a69131abaae5277b8f73b87f8d5f7224.jpg not downloaded yet
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062e72d0>
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_316f4306308c478bb468d4c4330a6d87.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_316f4306308c478bb468d4c4330a6d87.jpg saved to cache
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3dc9d78-c240-5bb5-94a4-f52affb3593c
2026-03-30 09:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_24d3ebc51a1da0d822d509f0c613181e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:14 [auto1.it] INFO: Found listing with ID: ZC32771
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC32771%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [auto1.it] INFO: Scrape type for ZC32771: 2
2026-03-30 09:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2745e45e-9503-58e7-8c60-99d40bd4f1b4 with identifier: ZC32771
2026-03-30 09:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2745e45e-9503-58e7-8c60-99d40bd4f1b4 with scrape type 2
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2745e45e-9503-58e7-8c60-99d40bd4f1b4 with scrape type 2
2026-03-30 09:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2745e45e-9503-58e7-8c60-99d40bd4f1b4, identifier: ZC32771
2026-03-30 09:06:14 [auto1.it] INFO: Found listing with ID: UF95553
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF95553%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [auto1.it] INFO: Scrape type for UF95553: 2
2026-03-30 09:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f8c0cae-eb13-5866-942d-e400c459c4b4 with identifier: UF95553
2026-03-30 09:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f8c0cae-eb13-5866-942d-e400c459c4b4 with scrape type 2
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f8c0cae-eb13-5866-942d-e400c459c4b4 with scrape type 2
2026-03-30 09:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f8c0cae-eb13-5866-942d-e400c459c4b4, identifier: UF95553
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F43%252Fef43bbdab50eb0b3d310b43d888a53eb%252Fpa%252FAK22038_714bc7d8ee6350e53f7b6d7bf7557605.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_714bc7d8ee6350e53f7b6d7bf7557605.jpg not downloaded yet
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_89aeb2b5f55b12a82f002d2b205a3eed.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_89aeb2b5f55b12a82f002d2b205a3eed.jpg not downloaded yet
2026-03-30 09:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_96c12a32cca9a7921142fff09ca333d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_d44bb210448e46b8ac49e144b6c3307c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2745e45e-9503-58e7-8c60-99d40bd4f1b4 with identifier: ZC32771
2026-03-30 09:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2745e45e-9503-58e7-8c60-99d40bd4f1b4 with identifier: ZC32771
2026-03-30 09:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2745e45e-9503-58e7-8c60-99d40bd4f1b4 with identifier: ZC32771 to the API
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:41Z',
 'fuel_type': 'diesel',
 'id': '2745e45e-9503-58e7-8c60-99d40bd4f1b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC32771',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 189928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-13',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Momentum Core 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Core 2WD',
 'year': 2020}
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC32771%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [auto1.it] INFO: Saving data for ZC32771: {'auction_closing_time': 1774882841.0, 'created_time': 1774774902.311251, 'last_price_update_time': 1774861575.23052}
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZC32771') HTTP/1.1" 204 0
2026-03-30 09:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f8c0cae-eb13-5866-942d-e400c459c4b4 with identifier: UF95553
2026-03-30 09:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f8c0cae-eb13-5866-942d-e400c459c4b4 with identifier: UF95553
2026-03-30 09:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f8c0cae-eb13-5866-942d-e400c459c4b4 with identifier: UF95553 to the API
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:22:24Z',
 'fuel_type': 'petrol',
 'id': '9f8c0cae-eb13-5866-942d-e400c459c4b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF95553',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 133890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-31',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF95553%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [auto1.it] INFO: Saving data for UF95553: {'auction_closing_time': 1774884144.0, 'created_time': 1774774892.241577, 'last_price_update_time': 1774861575.686963}
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UF95553') HTTP/1.1" 204 0
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_d86aeaed559c239f9645390212ef9415.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_d86aeaed559c239f9645390212ef9415.jpg not downloaded yet
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_59e10c1b54ca6988ebaa881c5c68e365.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_59e10c1b54ca6988ebaa881c5c68e365.jpg not downloaded yet
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_a6a781f583dcd7f0fcf20e8a3c739b88.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_a6a781f583dcd7f0fcf20e8a3c739b88.jpg not downloaded yet
2026-03-30 09:06:15 [auto1.it] INFO: Found listing with ID: DX48884
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX48884%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [auto1.it] INFO: Scrape type for DX48884: 0
2026-03-30 09:06:15 [auto1.it] INFO: Found listing with ID: VB04552
2026-03-30 09:06:15 [auto1.it] INFO: Found listing with ID: AR75288
2026-03-30 09:06:15 [auto1.it] INFO: Found listing with ID: NV53187
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV53187%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [auto1.it] INFO: Scrape type for NV53187: 2
2026-03-30 09:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ba76756-2bbe-5e0c-95ea-5503927ae4f2 with identifier: NV53187
2026-03-30 09:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ba76756-2bbe-5e0c-95ea-5503927ae4f2 with scrape type 2
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ba76756-2bbe-5e0c-95ea-5503927ae4f2 with scrape type 2
2026-03-30 09:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3ba76756-2bbe-5e0c-95ea-5503927ae4f2, identifier: NV53187
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F43%252Fef43bbdab50eb0b3d310b43d888a53eb%252Fpa%252FAK22038_ff25e0a49995c8e3ad0ecc27dd7be0e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_ff25e0a49995c8e3ad0ecc27dd7be0e0.jpg not downloaded yet
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_b250658c90dc3bfc80e70e5e28b5d1a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_b250658c90dc3bfc80e70e5e28b5d1a9.jpg not downloaded yet
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH48340> (referer: https://www.auto1.com/v1/car-details-view/KH48340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ75115> (referer: https://www.auto1.com/v1/car-details-view/PZ75115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06171650>
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_f0d2d3abc1b2f71d59f45111706f2906.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_f0d2d3abc1b2f71d59f45111706f2906.jpg saved to cache
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3dc9d78-c240-5bb5-94a4-f52affb3593c
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_8f6be120a361a150df154b8de6c33096.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_d0db4572b863bf1d90d2da665e200423.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3ba76756-2bbe-5e0c-95ea-5503927ae4f2 with identifier: NV53187
2026-03-30 09:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3ba76756-2bbe-5e0c-95ea-5503927ae4f2 with identifier: NV53187
2026-03-30 09:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3ba76756-2bbe-5e0c-95ea-5503927ae4f2 with identifier: NV53187 to the API
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:36:10Z',
 'fuel_type': 'diesel',
 'id': '3ba76756-2bbe-5e0c-95ea-5503927ae4f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV53187',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 182209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-28',
 'seller_name': None,
 'title': 'Audi A4 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV53187%27 HTTP/1.1" 200 None
2026-03-30 09:06:16 [auto1.it] INFO: Saving data for NV53187: {'auction_closing_time': 1774884970.0, 'created_time': 1773135033.072634, 'last_price_update_time': 1774861576.480395}
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NV53187') HTTP/1.1" 204 0
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_6d0b031587cbf145f72f3506c3e85809.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_6d0b031587cbf145f72f3506c3e85809.jpg not downloaded yet
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_c95ab401246206f997cd21b9495549ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_c95ab401246206f997cd21b9495549ff.jpg not downloaded yet
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_a69e1eaa61d9cf0608b165536bef695c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_a69e1eaa61d9cf0608b165536bef695c.jpg not downloaded yet
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_6772475beade01fe8eca195a7e5afd15.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:16 [auto1.it] INFO: Found listing with ID: LV27017
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV27017%27 HTTP/1.1" 200 None
2026-03-30 09:06:16 [auto1.it] INFO: Scrape type for LV27017: 2
2026-03-30 09:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddb7aab3-4938-5190-ae7a-a48097ae22d1 with identifier: LV27017
2026-03-30 09:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddb7aab3-4938-5190-ae7a-a48097ae22d1 with scrape type 2
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddb7aab3-4938-5190-ae7a-a48097ae22d1 with scrape type 2
2026-03-30 09:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ddb7aab3-4938-5190-ae7a-a48097ae22d1, identifier: LV27017
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_bb36b5f656129dca6e9cf6d3129a1fad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_bb36b5f656129dca6e9cf6d3129a1fad.jpg not downloaded yet
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063e2950>
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F70%252F4b7043f90f609e5371c8c9a342c64eeb%252Fpa%252FWN04356_24d3ebc51a1da0d822d509f0c613181e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_24d3ebc51a1da0d822d509f0c613181e.jpg saved to cache
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3dc9d78-c240-5bb5-94a4-f52affb3593c
2026-03-30 09:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3dc9d78-c240-5bb5-94a4-f52affb3593c, skipping ID generation
2026-03-30 09:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3dc9d78-c240-5bb5-94a4-f52affb3593c with scrape type 1
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3dc9d78-c240-5bb5-94a4-f52affb3593c sending to next pipeline
2026-03-30 09:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d3dc9d78-c240-5bb5-94a4-f52affb3593c, identifier: WN04356
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061df6d0>
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_96c12a32cca9a7921142fff09ca333d2.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_96c12a32cca9a7921142fff09ca333d2.jpg saved to cache
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ce1350>
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92bd73e9-d911-5e2d-8dd6-d7bf46f57d26/92bd73e9-d911-5e2d-8dd6-d7bf46f57d26_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F43%252Fef43bbdab50eb0b3d310b43d888a53eb%252Fpa%252FAK22038_d44bb210448e46b8ac49e144b6c3307c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_d44bb210448e46b8ac49e144b6c3307c.jpg saved to cache
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_e9a9cb07030b6801c6381d9cd26a832a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_a4a109a92187872eac846f2b029a1edf.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_639488f2de7e071417b22aa3ef5266f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ddb7aab3-4938-5190-ae7a-a48097ae22d1 with identifier: LV27017
2026-03-30 09:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ddb7aab3-4938-5190-ae7a-a48097ae22d1 with identifier: LV27017
2026-03-30 09:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ddb7aab3-4938-5190-ae7a-a48097ae22d1 with identifier: LV27017 to the API
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:21:00Z',
 'fuel_type': 'diesel',
 'id': 'ddb7aab3-4938-5190-ae7a-a48097ae22d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV27017',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 130957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-23',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2017}
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV27017%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [auto1.it] INFO: Saving data for LV27017: {'auction_closing_time': 1774884060.0, 'created_time': 1771876905.571797, 'last_price_update_time': 1774861577.467915}
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LV27017') HTTP/1.1" 204 0
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_676ce7a476843f23829cf8a802188cd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_676ce7a476843f23829cf8a802188cd5.jpg not downloaded yet
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_ade4108add2bdcd2734c272ddbb9e253.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_ade4108add2bdcd2734c272ddbb9e253.jpg not downloaded yet
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_5e8948ddbe2251b7b6b7598cef3713f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_5e8948ddbe2251b7b6b7598cef3713f5.jpg not downloaded yet
2026-03-30 09:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d3dc9d78-c240-5bb5-94a4-f52affb3593c with identifier: WN04356
2026-03-30 09:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d3dc9d78-c240-5bb5-94a4-f52affb3593c with identifier: WN04356
2026-03-30 09:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d3dc9d78-c240-5bb5-94a4-f52affb3593c with identifier: WN04356 to the API
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_24d3ebc51a1da0d822d509f0c613181e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:34:02Z',
 'fuel_type': 'diesel',
 'id': 'd3dc9d78-c240-5bb5-94a4-f52affb3593c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN04356',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 405526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_8a7e40e2a43bffa0d1fd71bebf5cf114.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_5f9246d47eee6da0d8bdc2e4c7c44832.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_1ab213f6d39b15063d230b5e7fe4d38a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_5ebc93a60b70fdf93f2f3bc53c896395.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_e3ab770b6a9ceb4bdfbcbf5208b36dd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_edfe73446bb4d45f8f5da1e8619a20e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_5a7d2112ee3b107dd6b5a488e04295e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_316f4306308c478bb468d4c4330a6d87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_f0d2d3abc1b2f71d59f45111706f2906.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3dc9d78-c240-5bb5-94a4-f52affb3593c/d3dc9d78-c240-5bb5-94a4-f52affb3593c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/70/4b7043f90f609e5371c8c9a342c64eeb/pa/WN04356_24d3ebc51a1da0d822d509f0c613181e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN04356%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [auto1.it] INFO: Saving data for WN04356: {'created_time': 1774861578.093098, 'last_price_update_time': 1774861578.093108, 'auction_closing_time': 1774971242.0}
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WN04356') HTTP/1.1" 204 0
2026-03-30 09:06:18 [auto1.it] INFO: Found listing with ID: PW45536
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW45536%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [auto1.it] INFO: Scrape type for PW45536: 2
2026-03-30 09:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7afecb28-d30c-5223-b38e-934cb656689a with identifier: PW45536
2026-03-30 09:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7afecb28-d30c-5223-b38e-934cb656689a with scrape type 2
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7afecb28-d30c-5223-b38e-934cb656689a with scrape type 2
2026-03-30 09:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7afecb28-d30c-5223-b38e-934cb656689a, identifier: PW45536
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_fa2a7f793c8b6787f239725d146167e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_fa2a7f793c8b6787f239725d146167e1.jpg not downloaded yet
2026-03-30 09:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_a69131abaae5277b8f73b87f8d5f7224.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7afecb28-d30c-5223-b38e-934cb656689a with identifier: PW45536
2026-03-30 09:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7afecb28-d30c-5223-b38e-934cb656689a with identifier: PW45536
2026-03-30 09:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7afecb28-d30c-5223-b38e-934cb656689a with identifier: PW45536 to the API
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:38:53Z',
 'fuel_type': 'diesel',
 'id': '7afecb28-d30c-5223-b38e-934cb656689a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW45536',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 228928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-18',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Executive 2WD',
 'transmission': 'automatic',
 'trim': 'Executive 2WD',
 'year': 2018}
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW45536%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [auto1.it] INFO: Saving data for PW45536: {'auction_closing_time': 1774885133.0, 'created_time': 1774472488.730973, 'last_price_update_time': 1774861578.587707}
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW45536') HTTP/1.1" 204 0
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_bd56a2a30ad348d1dc269362fd1985d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_bd56a2a30ad348d1dc269362fd1985d5.jpg not downloaded yet
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_12ef038b61439c9166f79763e97c437c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_12ef038b61439c9166f79763e97c437c.jpg not downloaded yet
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_da38afd93f80f628d656c3d6b6e6623b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_da38afd93f80f628d656c3d6b6e6623b.jpg not downloaded yet
2026-03-30 09:06:18 [auto1.it] INFO: Channel: 24h | Page: 26 | totalHits: 3304 | hits on page: 40
2026-03-30 09:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c60344d-9ceb-5d5d-b233-c38d680ee5d0 with identifier: KH48340
2026-03-30 09:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0 with scrape type 1
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_6f8f2112217295b4a39743e64ad39a43.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_6f8f2112217295b4a39743e64ad39a43.jpg not downloaded yet
2026-03-30 09:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63f24589-eaca-57e0-8eae-c12a3524906c with identifier: PZ75115
2026-03-30 09:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63f24589-eaca-57e0-8eae-c12a3524906c with scrape type 1
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63f24589-eaca-57e0-8eae-c12a3524906c
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_167d2288bc243d0becb9cb4ac9a4d46a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_167d2288bc243d0becb9cb4ac9a4d46a.jpg not downloaded yet
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06171250>
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92bd73e9-d911-5e2d-8dd6-d7bf46f57d26/92bd73e9-d911-5e2d-8dd6-d7bf46f57d26_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F43%252Fef43bbdab50eb0b3d310b43d888a53eb%252Fpa%252FAK22038_8f6be120a361a150df154b8de6c33096.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_8f6be120a361a150df154b8de6c33096.jpg saved to cache
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06022510>
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_d0db4572b863bf1d90d2da665e200423.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_d0db4572b863bf1d90d2da665e200423.jpg saved to cache
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d06e3d0>
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_6772475beade01fe8eca195a7e5afd15.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_6772475beade01fe8eca195a7e5afd15.jpg saved to cache
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ddedd1e-0af2-5907-ae91-178525b040c0
2026-03-30 09:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_89aeb2b5f55b12a82f002d2b205a3eed.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_cf03e0ff3bf6028cb9909aab28758248.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:18 [auto1.it] INFO: Found listing with ID: CV60051
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV60051%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [auto1.it] INFO: Scrape type for CV60051: 2
2026-03-30 09:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b885024e-aa1f-5197-9c90-6b57f0ba8a79 with identifier: CV60051
2026-03-30 09:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b885024e-aa1f-5197-9c90-6b57f0ba8a79 with scrape type 2
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b885024e-aa1f-5197-9c90-6b57f0ba8a79 with scrape type 2
2026-03-30 09:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b885024e-aa1f-5197-9c90-6b57f0ba8a79, identifier: CV60051
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_a204f5e8a0b33f6d15fe0e3f751b24c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_a204f5e8a0b33f6d15fe0e3f751b24c7.jpg not downloaded yet
2026-03-30 09:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_c50438b79cb07ae02c65e070a1582e71.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_714bc7d8ee6350e53f7b6d7bf7557605.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_ff25e0a49995c8e3ad0ecc27dd7be0e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_b250658c90dc3bfc80e70e5e28b5d1a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b885024e-aa1f-5197-9c90-6b57f0ba8a79 with identifier: CV60051
2026-03-30 09:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b885024e-aa1f-5197-9c90-6b57f0ba8a79 with identifier: CV60051
2026-03-30 09:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b885024e-aa1f-5197-9c90-6b57f0ba8a79 with identifier: CV60051 to the API
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:52:57Z',
 'fuel_type': 'petrol',
 'id': 'b885024e-aa1f-5197-9c90-6b57f0ba8a79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV60051',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 62825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-19',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2022}
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV60051%27 HTTP/1.1" 200 None
2026-03-30 09:06:19 [auto1.it] INFO: Saving data for CV60051: {'auction_closing_time': 1774885977.0, 'created_time': 1772088108.396714, 'last_price_update_time': 1774861579.900597}
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV60051') HTTP/1.1" 204 0
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_7658b132a818c1d9e6432360c06b5e83.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_7658b132a818c1d9e6432360c06b5e83.jpg not downloaded yet
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_77c707f3c5b76d5283f61dee2333112d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_77c707f3c5b76d5283f61dee2333112d.jpg not downloaded yet
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_6572a9c92763a6658915e86fc235c812.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_6572a9c92763a6658915e86fc235c812.jpg not downloaded yet
2026-03-30 09:06:19 [auto1.it] INFO: Found listing with ID: CT54414
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT54414%27 HTTP/1.1" 200 None
2026-03-30 09:06:19 [auto1.it] INFO: Scrape type for CT54414: 2
2026-03-30 09:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d77856d-55f7-5137-bf4e-494229a04a7d with identifier: CT54414
2026-03-30 09:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d77856d-55f7-5137-bf4e-494229a04a7d with scrape type 2
2026-03-30 09:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d77856d-55f7-5137-bf4e-494229a04a7d with scrape type 2
2026-03-30 09:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3d77856d-55f7-5137-bf4e-494229a04a7d, identifier: CT54414
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_5b8f2a0fdf4a4863031080d307052b22.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_5b8f2a0fdf4a4863031080d307052b22.jpg not downloaded yet
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_be22bb9a90959deff3bbe45788db2b22.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_be22bb9a90959deff3bbe45788db2b22.jpg not downloaded yet
2026-03-30 09:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d06c350>
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_e9a9cb07030b6801c6381d9cd26a832a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_e9a9cb07030b6801c6381d9cd26a832a.jpg saved to cache
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a92a8841-4506-572a-b43e-dc02d7306fd8
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06112990>
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92bd73e9-d911-5e2d-8dd6-d7bf46f57d26/92bd73e9-d911-5e2d-8dd6-d7bf46f57d26_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F43%252Fef43bbdab50eb0b3d310b43d888a53eb%252Fpa%252FAK22038_a4a109a92187872eac846f2b029a1edf.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_a4a109a92187872eac846f2b029a1edf.jpg saved to cache
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063f88d0>
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_639488f2de7e071417b22aa3ef5266f6.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_639488f2de7e071417b22aa3ef5266f6.jpg saved to cache
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8
2026-03-30 09:06:20 [auto1.it] INFO: Found listing with ID: DX65690
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX65690%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [auto1.it] INFO: Scrape type for DX65690: 2
2026-03-30 09:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f63aa926-c052-5b2a-8201-4ac520ad7cfa with identifier: DX65690
2026-03-30 09:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f63aa926-c052-5b2a-8201-4ac520ad7cfa with scrape type 2
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f63aa926-c052-5b2a-8201-4ac520ad7cfa with scrape type 2
2026-03-30 09:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f63aa926-c052-5b2a-8201-4ac520ad7cfa, identifier: DX65690
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_efee34a7fbb52d54f5b88956194948a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_efee34a7fbb52d54f5b88956194948a6.jpg not downloaded yet
2026-03-30 09:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3d77856d-55f7-5137-bf4e-494229a04a7d with identifier: CT54414
2026-03-30 09:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3d77856d-55f7-5137-bf4e-494229a04a7d with identifier: CT54414
2026-03-30 09:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3d77856d-55f7-5137-bf4e-494229a04a7d with identifier: CT54414 to the API
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:46:58Z',
 'fuel_type': 'hybrid',
 'id': '3d77856d-55f7-5137-bf4e-494229a04a7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT54414',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 90861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-19',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 225 GT',
 'transmission': 'automatic',
 'trim': '225 GT',
 'year': 2021}
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT54414%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [auto1.it] INFO: Saving data for CT54414: {'auction_closing_time': 1774885618.0, 'created_time': 1772224529.227716, 'last_price_update_time': 1774861580.790485}
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CT54414') HTTP/1.1" 204 0
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cbe390>
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_a69131abaae5277b8f73b87f8d5f7224.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_a69131abaae5277b8f73b87f8d5f7224.jpg saved to cache
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcd88757-87e2-5f42-b40a-3051825e0992
2026-03-30 09:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_a6a781f583dcd7f0fcf20e8a3c739b88.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f63aa926-c052-5b2a-8201-4ac520ad7cfa with identifier: DX65690
2026-03-30 09:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f63aa926-c052-5b2a-8201-4ac520ad7cfa with identifier: DX65690
2026-03-30 09:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f63aa926-c052-5b2a-8201-4ac520ad7cfa with identifier: DX65690 to the API
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 126,
 'expiration_date': '2026-03-30T15:30:24Z',
 'fuel_type': 'petrol',
 'id': 'f63aa926-c052-5b2a-8201-4ac520ad7cfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX65690',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 84821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-03',
 'seller_name': None,
 'title': 'Honda Civic 1.0 VTEC Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2019}
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX65690%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [auto1.it] INFO: Saving data for DX65690: {'auction_closing_time': 1774884624.0, 'created_time': 1773414120.189331, 'last_price_update_time': 1774861581.218591}
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DX65690') HTTP/1.1" 204 0
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_ac7c0f8638ab8f593871655c96038936.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_ac7c0f8638ab8f593871655c96038936.jpg not downloaded yet
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_911a8863b12291f43d81c597a33113c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_911a8863b12291f43d81c597a33113c7.jpg not downloaded yet
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_8e95ea915bd9e567a2069533c493fecf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_8e95ea915bd9e567a2069533c493fecf.jpg not downloaded yet
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: BP08183
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: BN63914
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN63914%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [auto1.it] INFO: Scrape type for BN63914: 2
2026-03-30 09:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d99323a2-10a7-54b7-aa75-167518649737 with identifier: BN63914
2026-03-30 09:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99323a2-10a7-54b7-aa75-167518649737 with scrape type 2
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d99323a2-10a7-54b7-aa75-167518649737 with scrape type 2
2026-03-30 09:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d99323a2-10a7-54b7-aa75-167518649737, identifier: BN63914
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_4ab291ad0cfd84af73bb78e6f104be14.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_4ab291ad0cfd84af73bb78e6f104be14.jpg not downloaded yet
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_163431ae8a05e677f8d912859302434b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_163431ae8a05e677f8d912859302434b.jpg not downloaded yet
2026-03-30 09:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_6d0b031587cbf145f72f3506c3e85809.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_d86aeaed559c239f9645390212ef9415.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: LD05493
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: RN24419
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: MP43347
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: GM98091
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM98091%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [auto1.it] INFO: Scrape type for GM98091: 2
2026-03-30 09:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c3bb183-bae7-5a5c-a7b1-22ee34072844 with identifier: GM98091
2026-03-30 09:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c3bb183-bae7-5a5c-a7b1-22ee34072844 with scrape type 2
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c3bb183-bae7-5a5c-a7b1-22ee34072844 with scrape type 2
2026-03-30 09:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c3bb183-bae7-5a5c-a7b1-22ee34072844, identifier: GM98091
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_f5820120a60fdfe658c9eda6fa20fb20.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_f5820120a60fdfe658c9eda6fa20fb20.jpg not downloaded yet
2026-03-30 09:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d99323a2-10a7-54b7-aa75-167518649737 with identifier: BN63914
2026-03-30 09:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d99323a2-10a7-54b7-aa75-167518649737 with identifier: BN63914
2026-03-30 09:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d99323a2-10a7-54b7-aa75-167518649737 with identifier: BN63914 to the API
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:39:45Z',
 'fuel_type': 'petrol',
 'id': 'd99323a2-10a7-54b7-aa75-167518649737',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN63914',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 18540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-28',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.0 Turbo Sprint Q4',
 'transmission': 'automatic',
 'trim': 'Sprint Q4',
 'year': 2023}
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN63914%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [auto1.it] INFO: Saving data for BN63914: {'auction_closing_time': 1774885185.0, 'created_time': 1773781548.600996, 'last_price_update_time': 1774861581.972021}
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BN63914') HTTP/1.1" 204 0
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d85c50>
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_89aeb2b5f55b12a82f002d2b205a3eed.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_89aeb2b5f55b12a82f002d2b205a3eed.jpg saved to cache
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062ddc50>
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_cf03e0ff3bf6028cb9909aab28758248.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_cf03e0ff3bf6028cb9909aab28758248.jpg saved to cache
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ddedd1e-0af2-5907-ae91-178525b040c0
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06392210>
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_c50438b79cb07ae02c65e070a1582e71.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_c50438b79cb07ae02c65e070a1582e71.jpg saved to cache
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a92a8841-4506-572a-b43e-dc02d7306fd8
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c76810>
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92bd73e9-d911-5e2d-8dd6-d7bf46f57d26/92bd73e9-d911-5e2d-8dd6-d7bf46f57d26_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F43%252Fef43bbdab50eb0b3d310b43d888a53eb%252Fpa%252FAK22038_714bc7d8ee6350e53f7b6d7bf7557605.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_714bc7d8ee6350e53f7b6d7bf7557605.jpg saved to cache
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062dd550>
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92bd73e9-d911-5e2d-8dd6-d7bf46f57d26/92bd73e9-d911-5e2d-8dd6-d7bf46f57d26_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F43%252Fef43bbdab50eb0b3d310b43d888a53eb%252Fpa%252FAK22038_ff25e0a49995c8e3ad0ecc27dd7be0e0.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_ff25e0a49995c8e3ad0ecc27dd7be0e0.jpg saved to cache
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26
2026-03-30 09:06:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26, skipping ID generation
2026-03-30 09:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26 with scrape type 1
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26 sending to next pipeline
2026-03-30 09:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26, identifier: AK22038
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06142550>
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_b250658c90dc3bfc80e70e5e28b5d1a9.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_b250658c90dc3bfc80e70e5e28b5d1a9.jpg saved to cache
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8
2026-03-30 09:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_59e10c1b54ca6988ebaa881c5c68e365.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_c95ab401246206f997cd21b9495549ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c3bb183-bae7-5a5c-a7b1-22ee34072844 with identifier: GM98091
2026-03-30 09:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c3bb183-bae7-5a5c-a7b1-22ee34072844 with identifier: GM98091
2026-03-30 09:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c3bb183-bae7-5a5c-a7b1-22ee34072844 with identifier: GM98091 to the API
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:05:44Z',
 'fuel_type': 'petrol',
 'id': '3c3bb183-bae7-5a5c-a7b1-22ee34072844',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM98091',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 97265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-29',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 Momentum 2WD',
 'transmission': 'manual',
 'trim': 'Momentum 2WD',
 'year': 2018}
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM98091%27 HTTP/1.1" 200 None
2026-03-30 09:06:22 [auto1.it] INFO: Saving data for GM98091: {'auction_closing_time': 1774883144.0, 'created_time': 1773130956.011714, 'last_price_update_time': 1774861582.859549}
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GM98091') HTTP/1.1" 204 0
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_dd5e0750cf08552eca35ebeeec2fac38.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_dd5e0750cf08552eca35ebeeec2fac38.jpg not downloaded yet
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_2218e5e7100b6d8ef7905c177dfe7b44.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_2218e5e7100b6d8ef7905c177dfe7b44.jpg not downloaded yet
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_79b9e175fbb2d1206cd695ac870763a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_79b9e175fbb2d1206cd695ac870763a2.jpg not downloaded yet
2026-03-30 09:06:22 [auto1.it] INFO: Found listing with ID: HF95426
2026-03-30 09:06:22 [auto1.it] INFO: Found listing with ID: HP00544
2026-03-30 09:06:22 [auto1.it] INFO: Found listing with ID: BP79618
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP79618%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [auto1.it] INFO: Scrape type for BP79618: 2
2026-03-30 09:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0868933b-154b-52a2-9f3b-e960d5f8a82e with identifier: BP79618
2026-03-30 09:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0868933b-154b-52a2-9f3b-e960d5f8a82e with scrape type 2
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0868933b-154b-52a2-9f3b-e960d5f8a82e with scrape type 2
2026-03-30 09:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0868933b-154b-52a2-9f3b-e960d5f8a82e, identifier: BP79618
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_92c7b48730b4db13883c80f2f989efbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_92c7b48730b4db13883c80f2f989efbf.jpg not downloaded yet
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_624acfa666c651a7d23e299872dde509.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_624acfa666c651a7d23e299872dde509.jpg not downloaded yet
2026-03-30 09:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26 with identifier: AK22038
2026-03-30 09:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26 with identifier: AK22038
2026-03-30 09:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 92bd73e9-d911-5e2d-8dd6-d7bf46f57d26 with identifier: AK22038 to the API
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_ff25e0a49995c8e3ad0ecc27dd7be0e0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:03:18Z',
 'fuel_type': 'diesel',
 'id': '92bd73e9-d911-5e2d-8dd6-d7bf46f57d26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK22038',
 'listing': 'auction',
 'location': 'IT, Casamassima',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 212446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92bd73e9-d911-5e2d-8dd6-d7bf46f57d26/92bd73e9-d911-5e2d-8dd6-d7bf46f57d26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_d44bb210448e46b8ac49e144b6c3307c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92bd73e9-d911-5e2d-8dd6-d7bf46f57d26/92bd73e9-d911-5e2d-8dd6-d7bf46f57d26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_8f6be120a361a150df154b8de6c33096.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92bd73e9-d911-5e2d-8dd6-d7bf46f57d26/92bd73e9-d911-5e2d-8dd6-d7bf46f57d26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_a4a109a92187872eac846f2b029a1edf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92bd73e9-d911-5e2d-8dd6-d7bf46f57d26/92bd73e9-d911-5e2d-8dd6-d7bf46f57d26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_714bc7d8ee6350e53f7b6d7bf7557605.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92bd73e9-d911-5e2d-8dd6-d7bf46f57d26/92bd73e9-d911-5e2d-8dd6-d7bf46f57d26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/43/ef43bbdab50eb0b3d310b43d888a53eb/pa/AK22038_ff25e0a49995c8e3ad0ecc27dd7be0e0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-12-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.3 JTD Multijet Argento',
 'transmission': 'manual',
 'trim': 'Multijet Argento',
 'year': 2003}
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK22038%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [auto1.it] INFO: Saving data for AK22038: {'created_time': 1774861583.755542, 'last_price_update_time': 1774861583.755552, 'auction_closing_time': 1774969398.0}
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AK22038') HTTP/1.1" 204 0
2026-03-30 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_a69e1eaa61d9cf0608b165536bef695c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_5e8948ddbe2251b7b6b7598cef3713f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:23 [auto1.it] INFO: Found listing with ID: FZ84197
2026-03-30 09:06:23 [auto1.it] INFO: Found listing with ID: DD33299
2026-03-30 09:06:23 [auto1.it] INFO: Found listing with ID: YL53737
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL53737%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [auto1.it] INFO: Scrape type for YL53737: 2
2026-03-30 09:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84e96b8-b29e-506f-a259-a9c4d1a64df5 with identifier: YL53737
2026-03-30 09:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84e96b8-b29e-506f-a259-a9c4d1a64df5 with scrape type 2
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84e96b8-b29e-506f-a259-a9c4d1a64df5 with scrape type 2
2026-03-30 09:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d84e96b8-b29e-506f-a259-a9c4d1a64df5, identifier: YL53737
2026-03-30 09:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0868933b-154b-52a2-9f3b-e960d5f8a82e with identifier: BP79618
2026-03-30 09:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0868933b-154b-52a2-9f3b-e960d5f8a82e with identifier: BP79618
2026-03-30 09:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0868933b-154b-52a2-9f3b-e960d5f8a82e with identifier: BP79618 to the API
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:59Z',
 'fuel_type': 'diesel',
 'id': '0868933b-154b-52a2-9f3b-e960d5f8a82e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP79618',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 40666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-04',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2016}
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP79618%27 HTTP/1.1" 200 None
2026-03-30 09:06:24 [auto1.it] INFO: Saving data for BP79618: {'auction_closing_time': 1774883339.0, 'created_time': 1774645547.762285, 'last_price_update_time': 1774861584.576274}
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BP79618') HTTP/1.1" 204 0
2026-03-30 09:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_fa2a7f793c8b6787f239725d146167e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d84e96b8-b29e-506f-a259-a9c4d1a64df5 with identifier: YL53737
2026-03-30 09:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d84e96b8-b29e-506f-a259-a9c4d1a64df5 with identifier: YL53737
2026-03-30 09:06:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d84e96b8-b29e-506f-a259-a9c4d1a64df5 with identifier: YL53737 to the API
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:26:52Z',
 'fuel_type': 'diesel',
 'id': 'd84e96b8-b29e-506f-a259-a9c4d1a64df5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL53737',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 70738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-14',
 'seller_name': None,
 'title': 'Audi Q3 40 TDI quattro S Line',
 'transmission': 'automatic',
 'trim': 'quattro S Line',
 'year': 2020}
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL53737%27 HTTP/1.1" 200 None
2026-03-30 09:06:24 [auto1.it] INFO: Saving data for YL53737: {'auction_closing_time': 1774884412.0, 'created_time': 1771409361.464369, 'last_price_update_time': 1774861584.961417}
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YL53737') HTTP/1.1" 204 0
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_553d85639f3ccb10fdd917302ead5060.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_553d85639f3ccb10fdd917302ead5060.jpg not downloaded yet
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_b8eccead51bbf4d890fbd237f2b99f1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_b8eccead51bbf4d890fbd237f2b99f1e.jpg not downloaded yet
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_193bc6af430cc02ad44a3295c221bd19.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_193bc6af430cc02ad44a3295c221bd19.jpg not downloaded yet
2026-03-30 09:06:25 [auto1.it] INFO: Found listing with ID: JM07675
2026-03-30 09:06:25 [auto1.it] INFO: Found listing with ID: RH51266
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH51266%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [auto1.it] INFO: Scrape type for RH51266: 2
2026-03-30 09:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34c0295b-83de-53ea-93b1-d3d04b313d56 with identifier: RH51266
2026-03-30 09:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34c0295b-83de-53ea-93b1-d3d04b313d56 with scrape type 2
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34c0295b-83de-53ea-93b1-d3d04b313d56 with scrape type 2
2026-03-30 09:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34c0295b-83de-53ea-93b1-d3d04b313d56, identifier: RH51266
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_4af3380735b285ba3ec461f0e47f8936.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_4af3380735b285ba3ec461f0e47f8936.jpg not downloaded yet
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_c7f9f17bf9b603a2a9c6e8655836aff9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_c7f9f17bf9b603a2a9c6e8655836aff9.jpg not downloaded yet
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06038d10>
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_a6a781f583dcd7f0fcf20e8a3c739b88.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_a6a781f583dcd7f0fcf20e8a3c739b88.jpg saved to cache
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcd88757-87e2-5f42-b40a-3051825e0992
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e7b150>
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_6d0b031587cbf145f72f3506c3e85809.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_6d0b031587cbf145f72f3506c3e85809.jpg saved to cache
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ddedd1e-0af2-5907-ae91-178525b040c0
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e060348d0>
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_d86aeaed559c239f9645390212ef9415.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_d86aeaed559c239f9645390212ef9415.jpg saved to cache
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ddedd1e-0af2-5907-ae91-178525b040c0
2026-03-30 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_ade4108add2bdcd2734c272ddbb9e253.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_676ce7a476843f23829cf8a802188cd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:25 [auto1.it] INFO: Found listing with ID: TH12767
2026-03-30 09:06:25 [auto1.it] INFO: Found listing with ID: YY06074
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY06074%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [auto1.it] INFO: Scrape type for YY06074: 2
2026-03-30 09:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with identifier: YY06074
2026-03-30 09:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with scrape type 2
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with scrape type 2
2026-03-30 09:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b, identifier: YY06074
2026-03-30 09:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34c0295b-83de-53ea-93b1-d3d04b313d56 with identifier: RH51266
2026-03-30 09:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34c0295b-83de-53ea-93b1-d3d04b313d56 with identifier: RH51266
2026-03-30 09:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34c0295b-83de-53ea-93b1-d3d04b313d56 with identifier: RH51266 to the API
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:41:18Z',
 'fuel_type': 'petrol',
 'id': '34c0295b-83de-53ea-93b1-d3d04b313d56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH51266',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 113401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-20',
 'seller_name': None,
 'title': 'Opel Adam 1.2 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2014}
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH51266%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [auto1.it] INFO: Saving data for RH51266: {'auction_closing_time': 1774885278.0, 'created_time': 1771877173.227662, 'last_price_update_time': 1774861585.823174}
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RH51266') HTTP/1.1" 204 0
2026-03-30 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_167d2288bc243d0becb9cb4ac9a4d46a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_6f8f2112217295b4a39743e64ad39a43.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with identifier: YY06074
2026-03-30 09:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with identifier: YY06074
2026-03-30 09:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d50980f-b7d1-58d5-9381-a4dfc5cedc0b with identifier: YY06074 to the API
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:16:58Z',
 'fuel_type': 'diesel',
 'id': '4d50980f-b7d1-58d5-9381-a4dfc5cedc0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY06074',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 68559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-23',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar D300 R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2020}
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY06074%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [auto1.it] INFO: Saving data for YY06074: {'auction_closing_time': 1774883818.0, 'created_time': 1774386538.788114, 'last_price_update_time': 1774861586.237993}
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY06074') HTTP/1.1" 204 0
2026-03-30 09:06:26 [auto1.it] INFO: Found listing with ID: WX96902
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX96902%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [auto1.it] INFO: Scrape type for WX96902: 2
2026-03-30 09:06:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05a1ff7c-8c01-5407-a9e7-65aa6426ddf3 with identifier: WX96902
2026-03-30 09:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05a1ff7c-8c01-5407-a9e7-65aa6426ddf3 with scrape type 2
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05a1ff7c-8c01-5407-a9e7-65aa6426ddf3 with scrape type 2
2026-03-30 09:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 05a1ff7c-8c01-5407-a9e7-65aa6426ddf3, identifier: WX96902
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_68c8acafed89665dd7c6592714b031ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_68c8acafed89665dd7c6592714b031ff.jpg not downloaded yet
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_59a08f53f8aec675b6bb782d1b2c92a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_59a08f53f8aec675b6bb782d1b2c92a1.jpg not downloaded yet
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d0c350>
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_59e10c1b54ca6988ebaa881c5c68e365.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_59e10c1b54ca6988ebaa881c5c68e365.jpg saved to cache
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a92a8841-4506-572a-b43e-dc02d7306fd8
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d066090>
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_c95ab401246206f997cd21b9495549ff.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_c95ab401246206f997cd21b9495549ff.jpg saved to cache
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a92a8841-4506-572a-b43e-dc02d7306fd8
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0636b750>
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_a69e1eaa61d9cf0608b165536bef695c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_a69e1eaa61d9cf0608b165536bef695c.jpg saved to cache
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcd88757-87e2-5f42-b40a-3051825e0992
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d065b90>
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_5e8948ddbe2251b7b6b7598cef3713f5.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_5e8948ddbe2251b7b6b7598cef3713f5.jpg saved to cache
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcd88757-87e2-5f42-b40a-3051825e0992
2026-03-30 09:06:26 [auto1.it] INFO: Found listing with ID: BT07540
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT07540%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [auto1.it] INFO: Scrape type for BT07540: 2
2026-03-30 09:06:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdc3f18e-f2f2-5339-826a-7cc28e8857ee with identifier: BT07540
2026-03-30 09:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdc3f18e-f2f2-5339-826a-7cc28e8857ee with scrape type 2
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdc3f18e-f2f2-5339-826a-7cc28e8857ee with scrape type 2
2026-03-30 09:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fdc3f18e-f2f2-5339-826a-7cc28e8857ee, identifier: BT07540
2026-03-30 09:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 05a1ff7c-8c01-5407-a9e7-65aa6426ddf3 with identifier: WX96902
2026-03-30 09:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 05a1ff7c-8c01-5407-a9e7-65aa6426ddf3 with identifier: WX96902
2026-03-30 09:06:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 05a1ff7c-8c01-5407-a9e7-65aa6426ddf3 with identifier: WX96902 to the API
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:55Z',
 'fuel_type': 'diesel',
 'id': '05a1ff7c-8c01-5407-a9e7-65aa6426ddf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX96902',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 159370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2009}
2026-03-30 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX96902%27 HTTP/1.1" 200 None
2026-03-30 09:06:27 [auto1.it] INFO: Saving data for WX96902: {'auction_closing_time': 1774884895.0, 'created_time': 1772143076.254371, 'last_price_update_time': 1774861587.139818}
2026-03-30 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WX96902') HTTP/1.1" 204 0
2026-03-30 09:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d86f10>
2026-03-30 09:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_fa2a7f793c8b6787f239725d146167e1.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_fa2a7f793c8b6787f239725d146167e1.jpg saved to cache
2026-03-30 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8
2026-03-30 09:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_c2e003f9d51e61b466b8f12b24418dd0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_163431ae8a05e677f8d912859302434b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_efee34a7fbb52d54f5b88956194948a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_be22bb9a90959deff3bbe45788db2b22.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fdc3f18e-f2f2-5339-826a-7cc28e8857ee with identifier: BT07540
2026-03-30 09:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fdc3f18e-f2f2-5339-826a-7cc28e8857ee with identifier: BT07540
2026-03-30 09:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fdc3f18e-f2f2-5339-826a-7cc28e8857ee with identifier: BT07540 to the API
2026-03-30 09:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:04:51Z',
 'fuel_type': 'diesel',
 'id': 'fdc3f18e-f2f2-5339-826a-7cc28e8857ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT07540',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 101947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2018}
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT07540%27 HTTP/1.1" 200 None
2026-03-30 09:06:28 [auto1.it] INFO: Saving data for BT07540: {'auction_closing_time': 1774883091.0, 'created_time': 1774300070.590282, 'last_price_update_time': 1774861588.535633}
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BT07540') HTTP/1.1" 204 0
2026-03-30 09:06:28 [auto1.it] INFO: Found listing with ID: PY07878
2026-03-30 09:06:28 [auto1.it] INFO: Found listing with ID: KZ05620
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ05620%27 HTTP/1.1" 200 None
2026-03-30 09:06:28 [auto1.it] INFO: Scrape type for KZ05620: 2
2026-03-30 09:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ba55fcf-377c-5b84-a04c-fef80e31b529 with identifier: KZ05620
2026-03-30 09:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ba55fcf-377c-5b84-a04c-fef80e31b529 with scrape type 2
2026-03-30 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ba55fcf-377c-5b84-a04c-fef80e31b529 with scrape type 2
2026-03-30 09:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ba55fcf-377c-5b84-a04c-fef80e31b529, identifier: KZ05620
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_ed0534c90895f122e66c7481dfca73dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_ed0534c90895f122e66c7481dfca73dc.jpg not downloaded yet
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_995cc9d1df0ba145e5adb07fe1dc2e15.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_995cc9d1df0ba145e5adb07fe1dc2e15.jpg not downloaded yet
2026-03-30 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_da38afd93f80f628d656c3d6b6e6623b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_624acfa666c651a7d23e299872dde509.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_5b8f2a0fdf4a4863031080d307052b22.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:28 [auto1.it] INFO: Found listing with ID: GU21322
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU21322%27 HTTP/1.1" 200 None
2026-03-30 09:06:28 [auto1.it] INFO: Scrape type for GU21322: 2
2026-03-30 09:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4d32dba-dc9c-53c3-9112-a51ae9eddf53 with identifier: GU21322
2026-03-30 09:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4d32dba-dc9c-53c3-9112-a51ae9eddf53 with scrape type 2
2026-03-30 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4d32dba-dc9c-53c3-9112-a51ae9eddf53 with scrape type 2
2026-03-30 09:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4d32dba-dc9c-53c3-9112-a51ae9eddf53, identifier: GU21322
2026-03-30 09:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ba55fcf-377c-5b84-a04c-fef80e31b529 with identifier: KZ05620
2026-03-30 09:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ba55fcf-377c-5b84-a04c-fef80e31b529 with identifier: KZ05620
2026-03-30 09:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ba55fcf-377c-5b84-a04c-fef80e31b529 with identifier: KZ05620 to the API
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:16:24Z',
 'fuel_type': 'diesel',
 'id': '6ba55fcf-377c-5b84-a04c-fef80e31b529',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ05620',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 171804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-29',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 B-Tech',
 'transmission': 'automatic',
 'trim': 'Q4 B-Tech',
 'year': 2019}
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ05620%27 HTTP/1.1" 200 None
2026-03-30 09:06:29 [auto1.it] INFO: Saving data for KZ05620: {'auction_closing_time': 1774883784.0, 'created_time': 1773130504.824613, 'last_price_update_time': 1774861589.175982}
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KZ05620') HTTP/1.1" 204 0
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cc7550>
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_ade4108add2bdcd2734c272ddbb9e253.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_ade4108add2bdcd2734c272ddbb9e253.jpg saved to cache
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a92a8841-4506-572a-b43e-dc02d7306fd8
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ce1bd0>
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_676ce7a476843f23829cf8a802188cd5.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_676ce7a476843f23829cf8a802188cd5.jpg saved to cache
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ddedd1e-0af2-5907-ae91-178525b040c0
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06016d50>
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_167d2288bc243d0becb9cb4ac9a4d46a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_167d2288bc243d0becb9cb4ac9a4d46a.jpg saved to cache
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63f24589-eaca-57e0-8eae-c12a3524906c
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e408d0>
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_6f8f2112217295b4a39743e64ad39a43.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_6f8f2112217295b4a39743e64ad39a43.jpg saved to cache
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0
2026-03-30 09:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_4ab291ad0cfd84af73bb78e6f104be14.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4d32dba-dc9c-53c3-9112-a51ae9eddf53 with identifier: GU21322
2026-03-30 09:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4d32dba-dc9c-53c3-9112-a51ae9eddf53 with identifier: GU21322
2026-03-30 09:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4d32dba-dc9c-53c3-9112-a51ae9eddf53 with identifier: GU21322 to the API
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:24:03Z',
 'fuel_type': 'diesel',
 'id': 'd4d32dba-dc9c-53c3-9112-a51ae9eddf53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU21322',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 223605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-12',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 HDi Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2013}
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU21322%27 HTTP/1.1" 200 None
2026-03-30 09:06:29 [auto1.it] INFO: Saving data for GU21322: {'auction_closing_time': 1774884243.0, 'created_time': 1773130042.115651, 'last_price_update_time': 1774861589.708885}
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GU21322') HTTP/1.1" 204 0
2026-03-30 09:06:29 [auto1.it] INFO: Found listing with ID: NU85167
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU85167%27 HTTP/1.1" 200 None
2026-03-30 09:06:29 [auto1.it] INFO: Scrape type for NU85167: 2
2026-03-30 09:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d76dd25a-3d86-5d00-b0dc-c8809ba2e333 with identifier: NU85167
2026-03-30 09:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d76dd25a-3d86-5d00-b0dc-c8809ba2e333 with scrape type 2
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d76dd25a-3d86-5d00-b0dc-c8809ba2e333 with scrape type 2
2026-03-30 09:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d76dd25a-3d86-5d00-b0dc-c8809ba2e333, identifier: NU85167
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_3e4a8292fd10b576dcdc248f81f720e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_3e4a8292fd10b576dcdc248f81f720e9.jpg not downloaded yet
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_feb8433750f362684b11e1041d0ad61e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_feb8433750f362684b11e1041d0ad61e.jpg not downloaded yet
2026-03-30 09:06:29 [auto1.it] INFO: Found listing with ID: RF01908
2026-03-30 09:06:29 [auto1.it] INFO: Found listing with ID: TD67992
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD67992%27 HTTP/1.1" 200 None
2026-03-30 09:06:29 [auto1.it] INFO: Scrape type for TD67992: 0
2026-03-30 09:06:29 [auto1.it] INFO: Found listing with ID: AT20318
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT20318%27 HTTP/1.1" 200 None
2026-03-30 09:06:29 [auto1.it] INFO: Scrape type for AT20318: 2
2026-03-30 09:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e with identifier: AT20318
2026-03-30 09:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e with scrape type 2
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e with scrape type 2
2026-03-30 09:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e, identifier: AT20318
2026-03-30 09:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d76dd25a-3d86-5d00-b0dc-c8809ba2e333 with identifier: NU85167
2026-03-30 09:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d76dd25a-3d86-5d00-b0dc-c8809ba2e333 with identifier: NU85167
2026-03-30 09:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d76dd25a-3d86-5d00-b0dc-c8809ba2e333 with identifier: NU85167 to the API
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:46:10Z',
 'fuel_type': 'diesel',
 'id': 'd76dd25a-3d86-5d00-b0dc-c8809ba2e333',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU85167',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 130367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-08',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 e-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2013}
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU85167%27 HTTP/1.1" 200 None
2026-03-30 09:06:30 [auto1.it] INFO: Saving data for NU85167: {'auction_closing_time': 1774885570.0, 'created_time': 1772176986.332819, 'last_price_update_time': 1774861590.755842}
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NU85167') HTTP/1.1" 204 0
2026-03-30 09:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-03-30 09:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-03-30 09:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 09:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-03-30 09:06:30 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:03:27 12:42:46\x00'
2026-03-30 09:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-03-30 09:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06031550>
2026-03-30 09:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_c2e003f9d51e61b466b8f12b24418dd0.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_c2e003f9d51e61b466b8f12b24418dd0.jpg saved to cache
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcd88757-87e2-5f42-b40a-3051825e0992
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d9c8d0>
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_163431ae8a05e677f8d912859302434b.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_163431ae8a05e677f8d912859302434b.jpg saved to cache
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63f24589-eaca-57e0-8eae-c12a3524906c
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0600d510>
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_efee34a7fbb52d54f5b88956194948a6.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_efee34a7fbb52d54f5b88956194948a6.jpg saved to cache
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0cd9bfd0>
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_be22bb9a90959deff3bbe45788db2b22.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_be22bb9a90959deff3bbe45788db2b22.jpg saved to cache
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63f24589-eaca-57e0-8eae-c12a3524906c
2026-03-30 09:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_92c7b48730b4db13883c80f2f989efbf.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_c7f9f17bf9b603a2a9c6e8655836aff9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_4af3380735b285ba3ec461f0e47f8936.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e with identifier: AT20318
2026-03-30 09:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e with identifier: AT20318
2026-03-30 09:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 331d4894-b3ce-54f5-ab8c-b0a4a219ef2e with identifier: AT20318 to the API
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:53:09Z',
 'fuel_type': 'diesel',
 'id': '331d4894-b3ce-54f5-ab8c-b0a4a219ef2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT20318',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 60265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-13',
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2022}
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT20318%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [auto1.it] INFO: Saving data for AT20318: {'auction_closing_time': 1774885989.0, 'created_time': 1773130918.766614, 'last_price_update_time': 1774861591.761623}
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AT20318') HTTP/1.1" 204 0
2026-03-30 09:06:31 [auto1.it] INFO: Found listing with ID: YG23649
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG23649%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [auto1.it] INFO: Scrape type for YG23649: 2
2026-03-30 09:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c991d61-576b-5078-b96f-296505c9cf7f with identifier: YG23649
2026-03-30 09:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c991d61-576b-5078-b96f-296505c9cf7f with scrape type 2
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c991d61-576b-5078-b96f-296505c9cf7f with scrape type 2
2026-03-30 09:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c991d61-576b-5078-b96f-296505c9cf7f, identifier: YG23649
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_bab567db793d4e151537b278f981f09a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_bab567db793d4e151537b278f981f09a.jpg not downloaded yet
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_ca632f9d4bc65423f3bc98b7fa0a22d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_ca632f9d4bc65423f3bc98b7fa0a22d0.jpg not downloaded yet
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c80750>
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_da38afd93f80f628d656c3d6b6e6623b.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_da38afd93f80f628d656c3d6b6e6623b.jpg saved to cache
2026-03-30 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcd88757-87e2-5f42-b40a-3051825e0992
2026-03-30 09:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062ee510>
2026-03-30 09:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_624acfa666c651a7d23e299872dde509.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_624acfa666c651a7d23e299872dde509.jpg saved to cache
2026-03-30 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63f24589-eaca-57e0-8eae-c12a3524906c
2026-03-30 09:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c687d0>
2026-03-30 09:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_5b8f2a0fdf4a4863031080d307052b22.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_5b8f2a0fdf4a4863031080d307052b22.jpg saved to cache
2026-03-30 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0
2026-03-30 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_59a08f53f8aec675b6bb782d1b2c92a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_68c8acafed89665dd7c6592714b031ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_2218e5e7100b6d8ef7905c177dfe7b44.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_dd5e0750cf08552eca35ebeeec2fac38.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:32 [auto1.it] INFO: Found listing with ID: VD89462
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD89462%27 HTTP/1.1" 200 None
2026-03-30 09:06:32 [auto1.it] INFO: Scrape type for VD89462: 2
2026-03-30 09:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bbeff81-e519-552d-83b9-994117fd0260 with identifier: VD89462
2026-03-30 09:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bbeff81-e519-552d-83b9-994117fd0260 with scrape type 2
2026-03-30 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bbeff81-e519-552d-83b9-994117fd0260 with scrape type 2
2026-03-30 09:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7bbeff81-e519-552d-83b9-994117fd0260, identifier: VD89462
2026-03-30 09:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c991d61-576b-5078-b96f-296505c9cf7f with identifier: YG23649
2026-03-30 09:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c991d61-576b-5078-b96f-296505c9cf7f with identifier: YG23649
2026-03-30 09:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c991d61-576b-5078-b96f-296505c9cf7f with identifier: YG23649 to the API
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:04:23Z',
 'fuel_type': 'diesel',
 'id': '4c991d61-576b-5078-b96f-296505c9cf7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG23649',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 13999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-24',
 'seller_name': None,
 'title': 'Audi A5 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2024}
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG23649%27 HTTP/1.1" 200 None
2026-03-30 09:06:32 [auto1.it] INFO: Saving data for YG23649: {'auction_closing_time': 1774883063.0, 'created_time': 1774559174.549138, 'last_price_update_time': 1774861592.57359}
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YG23649') HTTP/1.1" 204 0
2026-03-30 09:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_79b9e175fbb2d1206cd695ac870763a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7bbeff81-e519-552d-83b9-994117fd0260 with identifier: VD89462
2026-03-30 09:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7bbeff81-e519-552d-83b9-994117fd0260 with identifier: VD89462
2026-03-30 09:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7bbeff81-e519-552d-83b9-994117fd0260 with identifier: VD89462 to the API
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-30T15:21:14Z',
 'fuel_type': 'diesel',
 'id': '7bbeff81-e519-552d-83b9-994117fd0260',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD89462',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90 Cross Country',
 'odometer': 137213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-03',
 'seller_name': None,
 'title': 'Volvo V90 Cross Country 2.0 D5 Pro AWD',
 'transmission': 'automatic',
 'trim': 'Pro AWD',
 'year': 2017}
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD89462%27 HTTP/1.1" 200 None
2026-03-30 09:06:32 [auto1.it] INFO: Saving data for VD89462: {'auction_closing_time': 1774884074.0, 'created_time': 1774774892.591306, 'last_price_update_time': 1774861592.926572}
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VD89462') HTTP/1.1" 204 0
2026-03-30 09:06:32 [auto1.it] INFO: Found listing with ID: ML72062
2026-03-30 09:06:32 [auto1.it] INFO: Found listing with ID: VC28082
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC28082%27 HTTP/1.1" 200 None
2026-03-30 09:06:32 [auto1.it] INFO: Scrape type for VC28082: 2
2026-03-30 09:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d161c7be-8cff-5b3a-b47a-7113dc8d8a3e with identifier: VC28082
2026-03-30 09:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d161c7be-8cff-5b3a-b47a-7113dc8d8a3e with scrape type 2
2026-03-30 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d161c7be-8cff-5b3a-b47a-7113dc8d8a3e with scrape type 2
2026-03-30 09:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d161c7be-8cff-5b3a-b47a-7113dc8d8a3e, identifier: VC28082
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_1570e565d761f2406b110818b97a04a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_1570e565d761f2406b110818b97a04a3.jpg not downloaded yet
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_be1fd06168096badbda42493bd54a539.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_be1fd06168096badbda42493bd54a539.jpg not downloaded yet
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0cf2e4d0>
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_4ab291ad0cfd84af73bb78e6f104be14.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_4ab291ad0cfd84af73bb78e6f104be14.jpg saved to cache
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0
2026-03-30 09:06:33 [auto1.it] INFO: Found listing with ID: MT35916
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT35916%27 HTTP/1.1" 200 None
2026-03-30 09:06:33 [auto1.it] INFO: Scrape type for MT35916: 2
2026-03-30 09:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 171d08fb-1308-551b-978c-b6d2365e680f with identifier: MT35916
2026-03-30 09:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 171d08fb-1308-551b-978c-b6d2365e680f with scrape type 2
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 171d08fb-1308-551b-978c-b6d2365e680f with scrape type 2
2026-03-30 09:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 171d08fb-1308-551b-978c-b6d2365e680f, identifier: MT35916
2026-03-30 09:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d161c7be-8cff-5b3a-b47a-7113dc8d8a3e with identifier: VC28082
2026-03-30 09:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d161c7be-8cff-5b3a-b47a-7113dc8d8a3e with identifier: VC28082
2026-03-30 09:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d161c7be-8cff-5b3a-b47a-7113dc8d8a3e with identifier: VC28082 to the API
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:38:01Z',
 'fuel_type': 'diesel',
 'id': 'd161c7be-8cff-5b3a-b47a-7113dc8d8a3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC28082',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 141333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-26',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d 4Matic Business',
 'transmission': 'automatic',
 'trim': '4Matic Business',
 'year': 2018}
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC28082%27 HTTP/1.1" 200 None
2026-03-30 09:06:33 [auto1.it] INFO: Saving data for VC28082: {'auction_closing_time': 1774885081.0, 'created_time': 1771704683.615783, 'last_price_update_time': 1774861593.631538}
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VC28082') HTTP/1.1" 204 0
2026-03-30 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_193bc6af430cc02ad44a3295c221bd19.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_b8eccead51bbf4d890fbd237f2b99f1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_553d85639f3ccb10fdd917302ead5060.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 171d08fb-1308-551b-978c-b6d2365e680f with identifier: MT35916
2026-03-30 09:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 171d08fb-1308-551b-978c-b6d2365e680f with identifier: MT35916
2026-03-30 09:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 171d08fb-1308-551b-978c-b6d2365e680f with identifier: MT35916 to the API
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:39:44Z',
 'fuel_type': 'diesel',
 'id': '171d08fb-1308-551b-978c-b6d2365e680f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT35916',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 158863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-22',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2015}
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT35916%27 HTTP/1.1" 200 None
2026-03-30 09:06:34 [auto1.it] INFO: Saving data for MT35916: {'auction_closing_time': 1774885184.0, 'created_time': 1772222804.974933, 'last_price_update_time': 1774861594.047462}
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MT35916') HTTP/1.1" 204 0
2026-03-30 09:06:34 [auto1.it] INFO: Found listing with ID: ZP66852
2026-03-30 09:06:34 [auto1.it] INFO: Found listing with ID: EC11217
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC11217%27 HTTP/1.1" 200 None
2026-03-30 09:06:34 [auto1.it] INFO: Scrape type for EC11217: 0
2026-03-30 09:06:34 [auto1.it] INFO: Found listing with ID: WT09600
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT09600%27 HTTP/1.1" 200 None
2026-03-30 09:06:34 [auto1.it] INFO: Scrape type for WT09600: 0
2026-03-30 09:06:34 [auto1.it] INFO: Found listing with ID: VK05865
2026-03-30 09:06:34 [auto1.it] INFO: Found listing with ID: NB08226
2026-03-30 09:06:34 [auto1.it] INFO: Found listing with ID: MA64070
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA64070%27 HTTP/1.1" 200 None
2026-03-30 09:06:34 [auto1.it] INFO: Scrape type for MA64070: 2
2026-03-30 09:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8685d03b-428e-5008-9113-922bd34fae4f with identifier: MA64070
2026-03-30 09:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8685d03b-428e-5008-9113-922bd34fae4f with scrape type 2
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8685d03b-428e-5008-9113-922bd34fae4f with scrape type 2
2026-03-30 09:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8685d03b-428e-5008-9113-922bd34fae4f, identifier: MA64070
2026-03-30 09:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_995cc9d1df0ba145e5adb07fe1dc2e15.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:34 [auto1.it] INFO: Found listing with ID: BN48518
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN48518%27 HTTP/1.1" 200 None
2026-03-30 09:06:34 [auto1.it] INFO: Scrape type for BN48518: 2
2026-03-30 09:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d6ddcf3-738f-59d6-a6ad-80a7744273a3 with identifier: BN48518
2026-03-30 09:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d6ddcf3-738f-59d6-a6ad-80a7744273a3 with scrape type 2
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d6ddcf3-738f-59d6-a6ad-80a7744273a3 with scrape type 2
2026-03-30 09:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7d6ddcf3-738f-59d6-a6ad-80a7744273a3, identifier: BN48518
2026-03-30 09:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8685d03b-428e-5008-9113-922bd34fae4f with identifier: MA64070
2026-03-30 09:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8685d03b-428e-5008-9113-922bd34fae4f with identifier: MA64070
2026-03-30 09:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8685d03b-428e-5008-9113-922bd34fae4f with identifier: MA64070 to the API
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:14:34Z',
 'fuel_type': 'diesel',
 'id': '8685d03b-428e-5008-9113-922bd34fae4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA64070',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 9163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-13',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2025}
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA64070%27 HTTP/1.1" 200 None
2026-03-30 09:06:34 [auto1.it] INFO: Saving data for MA64070: {'auction_closing_time': 1774883674.0, 'created_time': 1774040545.795459, 'last_price_update_time': 1774861594.681411}
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MA64070') HTTP/1.1" 204 0
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f5f010>
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_92c7b48730b4db13883c80f2f989efbf.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_92c7b48730b4db13883c80f2f989efbf.jpg saved to cache
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ee8050>
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_c7f9f17bf9b603a2a9c6e8655836aff9.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_c7f9f17bf9b603a2a9c6e8655836aff9.jpg saved to cache
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63f24589-eaca-57e0-8eae-c12a3524906c
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dc4750>
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_4af3380735b285ba3ec461f0e47f8936.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_4af3380735b285ba3ec461f0e47f8936.jpg saved to cache
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061a5a10>
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_59a08f53f8aec675b6bb782d1b2c92a1.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_59a08f53f8aec675b6bb782d1b2c92a1.jpg saved to cache
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63f24589-eaca-57e0-8eae-c12a3524906c
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06189f10>
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_68c8acafed89665dd7c6592714b031ff.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_68c8acafed89665dd7c6592714b031ff.jpg saved to cache
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06eea9d0>
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_2218e5e7100b6d8ef7905c177dfe7b44.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_2218e5e7100b6d8ef7905c177dfe7b44.jpg saved to cache
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a92a8841-4506-572a-b43e-dc02d7306fd8
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06dc5a90>
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_dd5e0750cf08552eca35ebeeec2fac38.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_dd5e0750cf08552eca35ebeeec2fac38.jpg saved to cache
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ddedd1e-0af2-5907-ae91-178525b040c0
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061a4bd0>
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_79b9e175fbb2d1206cd695ac870763a2.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_79b9e175fbb2d1206cd695ac870763a2.jpg saved to cache
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcd88757-87e2-5f42-b40a-3051825e0992
2026-03-30 09:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_f5820120a60fdfe658c9eda6fa20fb20.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_feb8433750f362684b11e1041d0ad61e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_3e4a8292fd10b576dcdc248f81f720e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7d6ddcf3-738f-59d6-a6ad-80a7744273a3 with identifier: BN48518
2026-03-30 09:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7d6ddcf3-738f-59d6-a6ad-80a7744273a3 with identifier: BN48518
2026-03-30 09:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7d6ddcf3-738f-59d6-a6ad-80a7744273a3 with identifier: BN48518 to the API
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:19Z',
 'fuel_type': 'diesel',
 'id': '7d6ddcf3-738f-59d6-a6ad-80a7744273a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN48518',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 49672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-27',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2019}
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN48518%27 HTTP/1.1" 200 None
2026-03-30 09:06:35 [auto1.it] INFO: Saving data for BN48518: {'auction_closing_time': 1774886059.0, 'created_time': 1772174687.430461, 'last_price_update_time': 1774861595.443412}
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BN48518') HTTP/1.1" 204 0
2026-03-30 09:06:35 [auto1.it] INFO: Found listing with ID: LD57265
2026-03-30 09:06:35 [auto1.it] INFO: Found listing with ID: SU00968
2026-03-30 09:06:35 [auto1.it] INFO: Found listing with ID: LC40122
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC40122%27 HTTP/1.1" 200 None
2026-03-30 09:06:35 [auto1.it] INFO: Scrape type for LC40122: 2
2026-03-30 09:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eee85f5-0ffb-59d2-9079-f6e3a3267b2a with identifier: LC40122
2026-03-30 09:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eee85f5-0ffb-59d2-9079-f6e3a3267b2a with scrape type 2
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3eee85f5-0ffb-59d2-9079-f6e3a3267b2a with scrape type 2
2026-03-30 09:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3eee85f5-0ffb-59d2-9079-f6e3a3267b2a, identifier: LC40122
2026-03-30 09:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_8e95ea915bd9e567a2069533c493fecf.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:35 [auto1.it] INFO: Found listing with ID: NV82845
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV82845%27 HTTP/1.1" 200 None
2026-03-30 09:06:35 [auto1.it] INFO: Scrape type for NV82845: 2
2026-03-30 09:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1200a295-5f9e-5f41-83f0-427b631481d6 with identifier: NV82845
2026-03-30 09:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1200a295-5f9e-5f41-83f0-427b631481d6 with scrape type 2
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1200a295-5f9e-5f41-83f0-427b631481d6 with scrape type 2
2026-03-30 09:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1200a295-5f9e-5f41-83f0-427b631481d6, identifier: NV82845
2026-03-30 09:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3eee85f5-0ffb-59d2-9079-f6e3a3267b2a with identifier: LC40122
2026-03-30 09:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3eee85f5-0ffb-59d2-9079-f6e3a3267b2a with identifier: LC40122
2026-03-30 09:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3eee85f5-0ffb-59d2-9079-f6e3a3267b2a with identifier: LC40122 to the API
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:37:12Z',
 'fuel_type': 'petrol',
 'id': '3eee85f5-0ffb-59d2-9079-f6e3a3267b2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC40122',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 32987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-16',
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 Advance S&S',
 'transmission': 'manual',
 'trim': 'Advance S&S',
 'year': 2017}
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC40122%27 HTTP/1.1" 200 None
2026-03-30 09:06:36 [auto1.it] INFO: Saving data for LC40122: {'auction_closing_time': 1774885032.0, 'created_time': 1773270152.999274, 'last_price_update_time': 1774861596.060554}
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC40122') HTTP/1.1" 204 0
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0dc0dd90>
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_193bc6af430cc02ad44a3295c221bd19.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_193bc6af430cc02ad44a3295c221bd19.jpg saved to cache
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcd88757-87e2-5f42-b40a-3051825e0992
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d4e9d0>
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_b8eccead51bbf4d890fbd237f2b99f1e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_b8eccead51bbf4d890fbd237f2b99f1e.jpg saved to cache
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a92a8841-4506-572a-b43e-dc02d7306fd8
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d0e350>
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_553d85639f3ccb10fdd917302ead5060.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_553d85639f3ccb10fdd917302ead5060.jpg saved to cache
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ddedd1e-0af2-5907-ae91-178525b040c0
2026-03-30 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_ed0534c90895f122e66c7481dfca73dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1200a295-5f9e-5f41-83f0-427b631481d6 with identifier: NV82845
2026-03-30 09:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1200a295-5f9e-5f41-83f0-427b631481d6 with identifier: NV82845
2026-03-30 09:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1200a295-5f9e-5f41-83f0-427b631481d6 with identifier: NV82845 to the API
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:22:58Z',
 'fuel_type': 'diesel',
 'id': '1200a295-5f9e-5f41-83f0-427b631481d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV82845',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 310904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-26',
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV82845%27 HTTP/1.1" 200 None
2026-03-30 09:06:36 [auto1.it] INFO: Saving data for NV82845: {'auction_closing_time': 1774884178.0, 'created_time': 1773131495.437031, 'last_price_update_time': 1774861596.750853}
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NV82845') HTTP/1.1" 204 0
2026-03-30 09:06:36 [auto1.it] INFO: Found listing with ID: AY64399
2026-03-30 09:06:36 [auto1.it] INFO: Found listing with ID: SV45287
2026-03-30 09:06:36 [auto1.it] INFO: Found listing with ID: YH31345
2026-03-30 09:06:36 [auto1.it] INFO: Found listing with ID: WR22265
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR22265%27 HTTP/1.1" 200 None
2026-03-30 09:06:36 [auto1.it] INFO: Scrape type for WR22265: 2
2026-03-30 09:06:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3d0ca87-da05-5708-8763-16362abd73f8 with identifier: WR22265
2026-03-30 09:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3d0ca87-da05-5708-8763-16362abd73f8 with scrape type 2
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3d0ca87-da05-5708-8763-16362abd73f8 with scrape type 2
2026-03-30 09:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b3d0ca87-da05-5708-8763-16362abd73f8, identifier: WR22265
2026-03-30 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06ff4f90>
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_995cc9d1df0ba145e5adb07fe1dc2e15.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_995cc9d1df0ba145e5adb07fe1dc2e15.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63f24589-eaca-57e0-8eae-c12a3524906c
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_be1fd06168096badbda42493bd54a539.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_ca632f9d4bc65423f3bc98b7fa0a22d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_bab567db793d4e151537b278f981f09a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [auto1.it] INFO: Found listing with ID: AL33371
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL33371%27 HTTP/1.1" 200 None
2026-03-30 09:06:37 [auto1.it] INFO: Scrape type for AL33371: 0
2026-03-30 09:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b3d0ca87-da05-5708-8763-16362abd73f8 with identifier: WR22265
2026-03-30 09:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b3d0ca87-da05-5708-8763-16362abd73f8 with identifier: WR22265
2026-03-30 09:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b3d0ca87-da05-5708-8763-16362abd73f8 with identifier: WR22265 to the API
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-30T15:47:46Z',
 'fuel_type': 'petrol',
 'id': 'b3d0ca87-da05-5708-8763-16362abd73f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR22265',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 46127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-02',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T2 Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2023}
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR22265%27 HTTP/1.1" 200 None
2026-03-30 09:06:37 [auto1.it] INFO: Saving data for WR22265: {'auction_closing_time': 1774885666.0, 'created_time': 1772178234.265502, 'last_price_update_time': 1774861597.404789}
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WR22265') HTTP/1.1" 204 0
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_ac7c0f8638ab8f593871655c96038936.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [auto1.it] INFO: Found listing with ID: RL06920
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL06920%27 HTTP/1.1" 200 None
2026-03-30 09:06:37 [auto1.it] INFO: Scrape type for RL06920: 2
2026-03-30 09:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6863c36a-1598-5ab6-9106-cdd312605390 with identifier: RL06920
2026-03-30 09:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6863c36a-1598-5ab6-9106-cdd312605390 with scrape type 2
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6863c36a-1598-5ab6-9106-cdd312605390 with scrape type 2
2026-03-30 09:06:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6863c36a-1598-5ab6-9106-cdd312605390, identifier: RL06920
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e062dd510>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_f5820120a60fdfe658c9eda6fa20fb20.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_f5820120a60fdfe658c9eda6fa20fb20.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cc3590>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_feb8433750f362684b11e1041d0ad61e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_feb8433750f362684b11e1041d0ad61e.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63f24589-eaca-57e0-8eae-c12a3524906c
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e060094d0>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_3e4a8292fd10b576dcdc248f81f720e9.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_3e4a8292fd10b576dcdc248f81f720e9.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06c9db90>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_8e95ea915bd9e567a2069533c493fecf.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_8e95ea915bd9e567a2069533c493fecf.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcd88757-87e2-5f42-b40a-3051825e0992
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_6572a9c92763a6658915e86fc235c812.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_1570e565d761f2406b110818b97a04a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6863c36a-1598-5ab6-9106-cdd312605390 with identifier: RL06920
2026-03-30 09:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6863c36a-1598-5ab6-9106-cdd312605390 with identifier: RL06920
2026-03-30 09:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6863c36a-1598-5ab6-9106-cdd312605390 with identifier: RL06920 to the API
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:56:58Z',
 'fuel_type': 'petrol',
 'id': '6863c36a-1598-5ab6-9106-cdd312605390',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL06920',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 39627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-30',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2022}
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL06920%27 HTTP/1.1" 200 None
2026-03-30 09:06:38 [auto1.it] INFO: Saving data for RL06920: {'auction_closing_time': 1774886218.0, 'created_time': 1773129746.041377, 'last_price_update_time': 1774861598.467049}
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RL06920') HTTP/1.1" 204 0
2026-03-30 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_77c707f3c5b76d5283f61dee2333112d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:38 [auto1.it] INFO: Found listing with ID: YT62048
2026-03-30 09:06:38 [auto1.it] INFO: Found listing with ID: YL77268
2026-03-30 09:06:38 [auto1.it] INFO: Found listing with ID: EF61328
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF61328%27 HTTP/1.1" 200 None
2026-03-30 09:06:38 [auto1.it] INFO: Scrape type for EF61328: 2
2026-03-30 09:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d048567-c324-56d2-9c9c-127090dcda01 with identifier: EF61328
2026-03-30 09:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d048567-c324-56d2-9c9c-127090dcda01 with scrape type 2
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d048567-c324-56d2-9c9c-127090dcda01 with scrape type 2
2026-03-30 09:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7d048567-c324-56d2-9c9c-127090dcda01, identifier: EF61328
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06193cd0>
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_ed0534c90895f122e66c7481dfca73dc.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_ed0534c90895f122e66c7481dfca73dc.jpg saved to cache
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0
2026-03-30 09:06:38 [auto1.it] INFO: Channel: 24h | Page: 27 | totalHits: 3305 | hits on page: 40
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f62390>
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_be1fd06168096badbda42493bd54a539.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_be1fd06168096badbda42493bd54a539.jpg saved to cache
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63f24589-eaca-57e0-8eae-c12a3524906c
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f5a890>
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Faf%252F66af1ceae3b1bdd0803f84f45c2cdfd7%252Fpa%252FPZ75115_ca632f9d4bc65423f3bc98b7fa0a22d0.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_ca632f9d4bc65423f3bc98b7fa0a22d0.jpg saved to cache
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63f24589-eaca-57e0-8eae-c12a3524906c
2026-03-30 09:06:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63f24589-eaca-57e0-8eae-c12a3524906c, skipping ID generation
2026-03-30 09:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63f24589-eaca-57e0-8eae-c12a3524906c with scrape type 1
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63f24589-eaca-57e0-8eae-c12a3524906c sending to next pipeline
2026-03-30 09:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 63f24589-eaca-57e0-8eae-c12a3524906c, identifier: PZ75115
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d067ed0>
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_bab567db793d4e151537b278f981f09a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_bab567db793d4e151537b278f981f09a.jpg saved to cache
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0
2026-03-30 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_7658b132a818c1d9e6432360c06b5e83.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7d048567-c324-56d2-9c9c-127090dcda01 with identifier: EF61328
2026-03-30 09:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7d048567-c324-56d2-9c9c-127090dcda01 with identifier: EF61328
2026-03-30 09:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7d048567-c324-56d2-9c9c-127090dcda01 with identifier: EF61328 to the API
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:56:27Z',
 'fuel_type': 'diesel',
 'id': '7d048567-c324-56d2-9c9c-127090dcda01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF61328',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Antara',
 'odometer': 108310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-26',
 'seller_name': None,
 'title': 'Opel Antara 2.2 CDTI Cosmo 4x4',
 'transmission': 'manual',
 'trim': 'Cosmo 4x4',
 'year': 2012}
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF61328%27 HTTP/1.1" 200 None
2026-03-30 09:06:39 [auto1.it] INFO: Saving data for EF61328: {'auction_closing_time': 1774886187.0, 'created_time': 1773131825.518357, 'last_price_update_time': 1774861599.273726}
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EF61328') HTTP/1.1" 204 0
2026-03-30 09:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 63f24589-eaca-57e0-8eae-c12a3524906c with identifier: PZ75115
2026-03-30 09:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 63f24589-eaca-57e0-8eae-c12a3524906c with identifier: PZ75115
2026-03-30 09:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 63f24589-eaca-57e0-8eae-c12a3524906c with identifier: PZ75115 to the API
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_ca632f9d4bc65423f3bc98b7fa0a22d0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:03:07Z',
 'fuel_type': 'diesel',
 'id': '63f24589-eaca-57e0-8eae-c12a3524906c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ75115',
 'listing': 'auction',
 'location': 'IT, Rovato',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 86585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_167d2288bc243d0becb9cb4ac9a4d46a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_be22bb9a90959deff3bbe45788db2b22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_163431ae8a05e677f8d912859302434b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_624acfa666c651a7d23e299872dde509.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_c7f9f17bf9b603a2a9c6e8655836aff9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_59a08f53f8aec675b6bb782d1b2c92a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_995cc9d1df0ba145e5adb07fe1dc2e15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_feb8433750f362684b11e1041d0ad61e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_ca632f9d4bc65423f3bc98b7fa0a22d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f24589-eaca-57e0-8eae-c12a3524906c/63f24589-eaca-57e0-8eae-c12a3524906c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/af/66af1ceae3b1bdd0803f84f45c2cdfd7/pa/PZ75115_be1fd06168096badbda42493bd54a539.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2016}
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ75115%27 HTTP/1.1" 200 None
2026-03-30 09:06:39 [auto1.it] INFO: Saving data for PZ75115: {'created_time': 1774861599.718712, 'last_price_update_time': 1774861599.718721, 'auction_closing_time': 1774969387.0}
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ75115') HTTP/1.1" 204 0
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06f5bbd0>
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_ac7c0f8638ab8f593871655c96038936.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_ac7c0f8638ab8f593871655c96038936.jpg saved to cache
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ddedd1e-0af2-5907-ae91-178525b040c0
2026-03-30 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_a204f5e8a0b33f6d15fe0e3f751b24c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_bd56a2a30ad348d1dc269362fd1985d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:39 [auto1.it] INFO: Found listing with ID: JK32872
2026-03-30 09:06:39 [auto1.it] INFO: Found listing with ID: FU79114
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU79114%27 HTTP/1.1" 200 None
2026-03-30 09:06:39 [auto1.it] INFO: Scrape type for FU79114: 0
2026-03-30 09:06:39 [auto1.it] INFO: Found listing with ID: NJ78354
2026-03-30 09:06:39 [auto1.it] INFO: Found listing with ID: TZ83605
2026-03-30 09:06:39 [auto1.it] INFO: Found listing with ID: DD73045
2026-03-30 09:06:39 [auto1.it] INFO: Found listing with ID: JL50472
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL50472%27 HTTP/1.1" 200 None
2026-03-30 09:06:39 [auto1.it] INFO: Scrape type for JL50472: 2
2026-03-30 09:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 863edc4d-2249-51e5-96c2-ffcc6ea0b76f with identifier: JL50472
2026-03-30 09:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 863edc4d-2249-51e5-96c2-ffcc6ea0b76f with scrape type 2
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 863edc4d-2249-51e5-96c2-ffcc6ea0b76f with scrape type 2
2026-03-30 09:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 863edc4d-2249-51e5-96c2-ffcc6ea0b76f, identifier: JL50472
2026-03-30 09:06:39 [auto1.it] INFO: Found listing with ID: CC19770
2026-03-30 09:06:39 [auto1.it] INFO: Found listing with ID: JJ73686
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ73686%27 HTTP/1.1" 200 None
2026-03-30 09:06:39 [auto1.it] INFO: Scrape type for JJ73686: 2
2026-03-30 09:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c45e8446-8482-5582-a99f-77648a703aaa with identifier: JJ73686
2026-03-30 09:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c45e8446-8482-5582-a99f-77648a703aaa with scrape type 2
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c45e8446-8482-5582-a99f-77648a703aaa with scrape type 2
2026-03-30 09:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c45e8446-8482-5582-a99f-77648a703aaa, identifier: JJ73686
2026-03-30 09:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_12ef038b61439c9166f79763e97c437c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_bb36b5f656129dca6e9cf6d3129a1fad.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 863edc4d-2249-51e5-96c2-ffcc6ea0b76f with identifier: JL50472
2026-03-30 09:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 863edc4d-2249-51e5-96c2-ffcc6ea0b76f with identifier: JL50472
2026-03-30 09:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 863edc4d-2249-51e5-96c2-ffcc6ea0b76f with identifier: JL50472 to the API
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:44:02Z',
 'fuel_type': 'diesel',
 'id': '863edc4d-2249-51e5-96c2-ffcc6ea0b76f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL50472',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 8253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-21',
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2024}
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL50472%27 HTTP/1.1" 200 None
2026-03-30 09:06:40 [auto1.it] INFO: Saving data for JL50472: {'auction_closing_time': 1774885442.0, 'created_time': 1772174929.010517, 'last_price_update_time': 1774861600.453478}
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JL50472') HTTP/1.1" 204 0
2026-03-30 09:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c45e8446-8482-5582-a99f-77648a703aaa with identifier: JJ73686
2026-03-30 09:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c45e8446-8482-5582-a99f-77648a703aaa with identifier: JJ73686
2026-03-30 09:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c45e8446-8482-5582-a99f-77648a703aaa with identifier: JJ73686 to the API
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:12:56Z',
 'fuel_type': 'diesel',
 'id': 'c45e8446-8482-5582-a99f-77648a703aaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ73686',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 23696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-07',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Sprint Q4',
 'transmission': 'automatic',
 'trim': 'Sprint Q4',
 'year': 2022}
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ73686%27 HTTP/1.1" 200 None
2026-03-30 09:06:40 [auto1.it] INFO: Saving data for JJ73686: {'auction_closing_time': 1774883576.0, 'created_time': 1773131239.593446, 'last_price_update_time': 1774861600.919088}
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JJ73686') HTTP/1.1" 204 0
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061c1210>
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a696b916cf534385beff72dcce6201f%252Fpa%252FYH66131_6572a9c92763a6658915e86fc235c812.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_6572a9c92763a6658915e86fc235c812.jpg saved to cache
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcd88757-87e2-5f42-b40a-3051825e0992
2026-03-30 09:06:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcd88757-87e2-5f42-b40a-3051825e0992, skipping ID generation
2026-03-30 09:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcd88757-87e2-5f42-b40a-3051825e0992 with scrape type 1
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcd88757-87e2-5f42-b40a-3051825e0992 sending to next pipeline
2026-03-30 09:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fcd88757-87e2-5f42-b40a-3051825e0992, identifier: YH66131
2026-03-30 09:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d4dcd0>
2026-03-30 09:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fd0%252F53d0aa1176c34c7562b23704661c585f%252Fpa%252FKH48340_1570e565d761f2406b110818b97a04a3.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_1570e565d761f2406b110818b97a04a3.jpg saved to cache
2026-03-30 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0
2026-03-30 09:06:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c60344d-9ceb-5d5d-b233-c38d680ee5d0, skipping ID generation
2026-03-30 09:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0 with scrape type 1
2026-03-30 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c60344d-9ceb-5d5d-b233-c38d680ee5d0 sending to next pipeline
2026-03-30 09:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c60344d-9ceb-5d5d-b233-c38d680ee5d0, identifier: KH48340
2026-03-30 09:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e0d0683d0>
2026-03-30 09:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_77c707f3c5b76d5283f61dee2333112d.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_77c707f3c5b76d5283f61dee2333112d.jpg saved to cache
2026-03-30 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a92a8841-4506-572a-b43e-dc02d7306fd8
2026-03-30 09:06:41 [auto1.it] INFO: Found listing with ID: EA68503
2026-03-30 09:06:41 [auto1.it] INFO: Found listing with ID: CC19770
2026-03-30 09:06:41 [auto1.it] INFO: Found listing with ID: JS86571
2026-03-30 09:06:41 [auto1.it] INFO: Found listing with ID: UZ46554
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ46554%27 HTTP/1.1" 200 None
2026-03-30 09:06:41 [auto1.it] INFO: Scrape type for UZ46554: 0
2026-03-30 09:06:41 [auto1.it] INFO: Found listing with ID: PM10706
2026-03-30 09:06:41 [auto1.it] INFO: Found listing with ID: CB30744
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB30744%27 HTTP/1.1" 200 None
2026-03-30 09:06:41 [auto1.it] INFO: Scrape type for CB30744: 0
2026-03-30 09:06:41 [auto1.it] INFO: Found listing with ID: MY09959
2026-03-30 09:06:41 [auto1.it] INFO: Found listing with ID: ML86144
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML86144%27 HTTP/1.1" 200 None
2026-03-30 09:06:41 [auto1.it] INFO: Scrape type for ML86144: 2
2026-03-30 09:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0162ada-0d53-5daa-8916-0ef5022ef47e with identifier: ML86144
2026-03-30 09:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0162ada-0d53-5daa-8916-0ef5022ef47e with scrape type 2
2026-03-30 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0162ada-0d53-5daa-8916-0ef5022ef47e with scrape type 2
2026-03-30 09:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d0162ada-0d53-5daa-8916-0ef5022ef47e, identifier: ML86144
2026-03-30 09:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fcd88757-87e2-5f42-b40a-3051825e0992 with identifier: YH66131
2026-03-30 09:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fcd88757-87e2-5f42-b40a-3051825e0992 with identifier: YH66131
2026-03-30 09:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fcd88757-87e2-5f42-b40a-3051825e0992 with identifier: YH66131 to the API
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_6572a9c92763a6658915e86fc235c812.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:55:58Z',
 'fuel_type': 'diesel',
 'id': 'fcd88757-87e2-5f42-b40a-3051825e0992',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH66131',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 44889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1057605,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_c2e003f9d51e61b466b8f12b24418dd0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_a69131abaae5277b8f73b87f8d5f7224.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_a6a781f583dcd7f0fcf20e8a3c739b88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_a69e1eaa61d9cf0608b165536bef695c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 149068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_5e8948ddbe2251b7b6b7598cef3713f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_da38afd93f80f628d656c3d6b6e6623b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_6572a9c92763a6658915e86fc235c812.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_8e95ea915bd9e567a2069533c493fecf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_79b9e175fbb2d1206cd695ac870763a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd88757-87e2-5f42-b40a-3051825e0992/fcd88757-87e2-5f42-b40a-3051825e0992_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a696b916cf534385beff72dcce6201f/pa/YH66131_193bc6af430cc02ad44a3295c221bd19.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 Sportback 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH66131%27 HTTP/1.1" 200 None
2026-03-30 09:06:41 [auto1.it] INFO: Saving data for YH66131: {'created_time': 1774861601.883826, 'last_price_update_time': 1774861601.883841, 'auction_closing_time': 1774972558.0}
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YH66131') HTTP/1.1" 204 0
2026-03-30 09:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c60344d-9ceb-5d5d-b233-c38d680ee5d0 with identifier: KH48340
2026-03-30 09:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c60344d-9ceb-5d5d-b233-c38d680ee5d0 with identifier: KH48340
2026-03-30 09:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c60344d-9ceb-5d5d-b233-c38d680ee5d0 with identifier: KH48340 to the API
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_1570e565d761f2406b110818b97a04a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:15:35Z',
 'fuel_type': 'petrol',
 'id': '4c60344d-9ceb-5d5d-b233-c38d680ee5d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH48340',
 'listing': 'auction',
 'location': 'IT, Villasanta',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 111393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_6f8f2112217295b4a39743e64ad39a43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_5b8f2a0fdf4a4863031080d307052b22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_4ab291ad0cfd84af73bb78e6f104be14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_92c7b48730b4db13883c80f2f989efbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_4af3380735b285ba3ec461f0e47f8936.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_68c8acafed89665dd7c6592714b031ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_ed0534c90895f122e66c7481dfca73dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_3e4a8292fd10b576dcdc248f81f720e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_bab567db793d4e151537b278f981f09a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c60344d-9ceb-5d5d-b233-c38d680ee5d0/4c60344d-9ceb-5d5d-b233-c38d680ee5d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/d0/53d0aa1176c34c7562b23704661c585f/pa/KH48340_1570e565d761f2406b110818b97a04a3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy R-Link',
 'transmission': 'manual',
 'trim': 'R-Link',
 'year': 2014}
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH48340%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [auto1.it] INFO: Saving data for KH48340: {'created_time': 1774861602.626678, 'last_price_update_time': 1774861602.626689, 'auction_closing_time': 1774970135.0}
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KH48340') HTTP/1.1" 204 0
2026-03-30 09:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d0162ada-0d53-5daa-8916-0ef5022ef47e with identifier: ML86144
2026-03-30 09:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d0162ada-0d53-5daa-8916-0ef5022ef47e with identifier: ML86144
2026-03-30 09:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d0162ada-0d53-5daa-8916-0ef5022ef47e with identifier: ML86144 to the API
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:19:12Z',
 'fuel_type': 'petrol',
 'id': 'd0162ada-0d53-5daa-8916-0ef5022ef47e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML86144',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 174357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-15',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2012}
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML86144%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [auto1.it] INFO: Saving data for ML86144: {'auction_closing_time': 1774883952.0, 'created_time': 1771448286.484795, 'last_price_update_time': 1774861602.970732}
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ML86144') HTTP/1.1" 204 0
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06d26ad0>
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_7658b132a818c1d9e6432360c06b5e83.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_7658b132a818c1d9e6432360c06b5e83.jpg saved to cache
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ddedd1e-0af2-5907-ae91-178525b040c0
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06fb2810>
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_a204f5e8a0b33f6d15fe0e3f751b24c7.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_a204f5e8a0b33f6d15fe0e3f751b24c7.jpg saved to cache
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e063da9d0>
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F0a%252F720a6dc976ce2d7b77208521eb088fb2%252Fpa%252FKU84675_bd56a2a30ad348d1dc269362fd1985d5.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_bd56a2a30ad348d1dc269362fd1985d5.jpg saved to cache
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ddedd1e-0af2-5907-ae91-178525b040c0
2026-03-30 09:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ddedd1e-0af2-5907-ae91-178525b040c0, skipping ID generation
2026-03-30 09:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ddedd1e-0af2-5907-ae91-178525b040c0 with scrape type 1
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ddedd1e-0af2-5907-ae91-178525b040c0 sending to next pipeline
2026-03-30 09:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7ddedd1e-0af2-5907-ae91-178525b040c0, identifier: KU84675
2026-03-30 09:06:43 [auto1.it] INFO: Found listing with ID: JM74615
2026-03-30 09:06:43 [auto1.it] INFO: Found listing with ID: HK60506
2026-03-30 09:06:43 [auto1.it] INFO: Found listing with ID: ZU26854
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU26854%27 HTTP/1.1" 200 None
2026-03-30 09:06:43 [auto1.it] INFO: Scrape type for ZU26854: 2
2026-03-30 09:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b2eec7b-2317-5371-af0a-1bdefe6f9bba with identifier: ZU26854
2026-03-30 09:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b2eec7b-2317-5371-af0a-1bdefe6f9bba with scrape type 2
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b2eec7b-2317-5371-af0a-1bdefe6f9bba with scrape type 2
2026-03-30 09:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b2eec7b-2317-5371-af0a-1bdefe6f9bba, identifier: ZU26854
2026-03-30 09:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7ddedd1e-0af2-5907-ae91-178525b040c0 with identifier: KU84675
2026-03-30 09:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7ddedd1e-0af2-5907-ae91-178525b040c0 with identifier: KU84675
2026-03-30 09:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7ddedd1e-0af2-5907-ae91-178525b040c0 with identifier: KU84675 to the API
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_bd56a2a30ad348d1dc269362fd1985d5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 222,
 'expiration_date': '2026-03-31T15:41:59Z',
 'fuel_type': 'hybrid',
 'id': '7ddedd1e-0af2-5907-ae91-178525b040c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU84675',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 90489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_6772475beade01fe8eca195a7e5afd15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_cf03e0ff3bf6028cb9909aab28758248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_d86aeaed559c239f9645390212ef9415.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_6d0b031587cbf145f72f3506c3e85809.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_676ce7a476843f23829cf8a802188cd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_bd56a2a30ad348d1dc269362fd1985d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_7658b132a818c1d9e6432360c06b5e83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_ac7c0f8638ab8f593871655c96038936.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_dd5e0750cf08552eca35ebeeec2fac38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddedd1e-0af2-5907-ae91-178525b040c0/7ddedd1e-0af2-5907-ae91-178525b040c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/0a/720a6dc976ce2d7b77208521eb088fb2/pa/KU84675_553d85639f3ccb10fdd917302ead5060.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x4 Lounge',
 'transmission': 'automatic',
 'trim': '4x4 Lounge',
 'year': 2021}
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU84675%27 HTTP/1.1" 200 None
2026-03-30 09:06:43 [auto1.it] INFO: Saving data for KU84675: {'created_time': 1774861603.870029, 'last_price_update_time': 1774861603.870043, 'auction_closing_time': 1774971719.0}
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KU84675') HTTP/1.1" 204 0
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06e98210>
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_12ef038b61439c9166f79763e97c437c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_12ef038b61439c9166f79763e97c437c.jpg saved to cache
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a92a8841-4506-572a-b43e-dc02d7306fd8
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e06cc0d90>
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F4f%252Fea4f651dceb6c6b052ddfea4ff5e92b1%252Fpa%252FUR67041_bb36b5f656129dca6e9cf6d3129a1fad.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_bb36b5f656129dca6e9cf6d3129a1fad.jpg saved to cache
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8
2026-03-30 09:06:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8, skipping ID generation
2026-03-30 09:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8 with scrape type 1
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8 sending to next pipeline
2026-03-30 09:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8, identifier: UR67041
2026-03-30 09:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b2eec7b-2317-5371-af0a-1bdefe6f9bba with identifier: ZU26854
2026-03-30 09:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b2eec7b-2317-5371-af0a-1bdefe6f9bba with identifier: ZU26854
2026-03-30 09:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b2eec7b-2317-5371-af0a-1bdefe6f9bba with identifier: ZU26854 to the API
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:19:19Z',
 'fuel_type': 'diesel',
 'id': '6b2eec7b-2317-5371-af0a-1bdefe6f9bba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU26854',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 104755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-30',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU26854%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [auto1.it] INFO: Saving data for ZU26854: {'auction_closing_time': 1774883959.0, 'created_time': 1773129817.280122, 'last_price_update_time': 1774861604.51033}
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU26854') HTTP/1.1" 204 0
2026-03-30 09:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8 with identifier: UR67041
2026-03-30 09:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8 with identifier: UR67041
2026-03-30 09:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8a9ddaab-0b24-5aa6-bb41-21717d15b5c8 with identifier: UR67041 to the API
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_bb36b5f656129dca6e9cf6d3129a1fad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:53:03Z',
 'fuel_type': 'diesel',
 'id': '8a9ddaab-0b24-5aa6-bb41-21717d15b5c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR67041',
 'listing': 'auction',
 'location': 'IT, Firenze',
 'make': 'BMW',
 'model': '1er',
 'odometer': 100085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_96c12a32cca9a7921142fff09ca333d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_d0db4572b863bf1d90d2da665e200423.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_639488f2de7e071417b22aa3ef5266f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_89aeb2b5f55b12a82f002d2b205a3eed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_b250658c90dc3bfc80e70e5e28b5d1a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_bb36b5f656129dca6e9cf6d3129a1fad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_fa2a7f793c8b6787f239725d146167e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_a204f5e8a0b33f6d15fe0e3f751b24c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_efee34a7fbb52d54f5b88956194948a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9ddaab-0b24-5aa6-bb41-21717d15b5c8/8a9ddaab-0b24-5aa6-bb41-21717d15b5c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/4f/ea4f651dceb6c6b052ddfea4ff5e92b1/pa/UR67041_f5820120a60fdfe658c9eda6fa20fb20.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d Edition M Sport Shadow',
 'transmission': 'manual',
 'trim': 'Edition M Sport Shadow',
 'year': 2018}
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR67041%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [auto1.it] INFO: Saving data for UR67041: {'created_time': 1774861604.98268, 'last_price_update_time': 1774861604.98269, 'auction_closing_time': 1774972383.0}
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UR67041') HTTP/1.1" 204 0
2026-03-30 09:06:45 [auto1.it] INFO: Found listing with ID: DR95248
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR95248%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [auto1.it] INFO: Scrape type for DR95248: 0
2026-03-30 09:06:45 [auto1.it] INFO: Found listing with ID: UK81379
2026-03-30 09:06:45 [auto1.it] INFO: Found listing with ID: DW65816
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW65816%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [auto1.it] INFO: Scrape type for DW65816: 2
2026-03-30 09:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 904b130f-1667-598a-ab8b-47bbe4c779cb with identifier: DW65816
2026-03-30 09:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 904b130f-1667-598a-ab8b-47bbe4c779cb with scrape type 2
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 904b130f-1667-598a-ab8b-47bbe4c779cb with scrape type 2
2026-03-30 09:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 904b130f-1667-598a-ab8b-47bbe4c779cb, identifier: DW65816
2026-03-30 09:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 904b130f-1667-598a-ab8b-47bbe4c779cb with identifier: DW65816
2026-03-30 09:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 904b130f-1667-598a-ab8b-47bbe4c779cb with identifier: DW65816
2026-03-30 09:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 904b130f-1667-598a-ab8b-47bbe4c779cb with identifier: DW65816 to the API
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:18:46Z',
 'fuel_type': 'petrol',
 'id': '904b130f-1667-598a-ab8b-47bbe4c779cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW65816',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 33191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2022}
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW65816%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [auto1.it] INFO: Saving data for DW65816: {'auction_closing_time': 1774883926.0, 'created_time': 1773131151.308219, 'last_price_update_time': 1774861605.48559}
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DW65816') HTTP/1.1" 204 0
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_911a8863b12291f43d81c597a33113c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [auto1.it] INFO: Found listing with ID: BX49691
2026-03-30 09:06:45 [auto1.it] INFO: Found listing with ID: AL00602
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL00602%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [auto1.it] INFO: Scrape type for AL00602: 2
2026-03-30 09:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c697f6c3-5558-5a2a-9070-322d25ec0462 with identifier: AL00602
2026-03-30 09:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c697f6c3-5558-5a2a-9070-322d25ec0462 with scrape type 2
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c697f6c3-5558-5a2a-9070-322d25ec0462 with scrape type 2
2026-03-30 09:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c697f6c3-5558-5a2a-9070-322d25ec0462, identifier: AL00602
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY93977> (referer: https://www.auto1.com/v1/car-details-view/LY93977/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c697f6c3-5558-5a2a-9070-322d25ec0462 with identifier: AL00602
2026-03-30 09:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c697f6c3-5558-5a2a-9070-322d25ec0462 with identifier: AL00602
2026-03-30 09:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c697f6c3-5558-5a2a-9070-322d25ec0462 with identifier: AL00602 to the API
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:51:17Z',
 'fuel_type': 'diesel',
 'id': 'c697f6c3-5558-5a2a-9070-322d25ec0462',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL00602',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 208211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-25',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Ghia',
 'transmission': 'automatic',
 'trim': 'Ghia',
 'year': 2008}
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL00602%27 HTTP/1.1" 200 None
2026-03-30 09:06:46 [auto1.it] INFO: Saving data for AL00602: {'auction_closing_time': 1774885877.0, 'created_time': 1773129552.24691, 'last_price_update_time': 1774861606.529008}
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL00602') HTTP/1.1" 204 0
2026-03-30 09:06:46 [auto1.it] INFO: Found listing with ID: MX95744
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX95744%27 HTTP/1.1" 200 None
2026-03-30 09:06:46 [auto1.it] INFO: Scrape type for MX95744: 0
2026-03-30 09:06:46 [auto1.it] INFO: Found listing with ID: KC58138
2026-03-30 09:06:46 [auto1.it] INFO: Found listing with ID: DP76328
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP76328%27 HTTP/1.1" 200 None
2026-03-30 09:06:46 [auto1.it] INFO: Scrape type for DP76328: 2
2026-03-30 09:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 002ad14d-b109-5e1d-b4e0-16c40499c7a8 with identifier: DP76328
2026-03-30 09:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 002ad14d-b109-5e1d-b4e0-16c40499c7a8 with scrape type 2
2026-03-30 09:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 002ad14d-b109-5e1d-b4e0-16c40499c7a8 with scrape type 2
2026-03-30 09:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 002ad14d-b109-5e1d-b4e0-16c40499c7a8, identifier: DP76328
2026-03-30 09:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 002ad14d-b109-5e1d-b4e0-16c40499c7a8 with identifier: DP76328
2026-03-30 09:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 002ad14d-b109-5e1d-b4e0-16c40499c7a8 with identifier: DP76328
2026-03-30 09:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 002ad14d-b109-5e1d-b4e0-16c40499c7a8 with identifier: DP76328 to the API
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:27Z',
 'fuel_type': 'diesel',
 'id': '002ad14d-b109-5e1d-b4e0-16c40499c7a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP76328',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 102887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-03',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Shooting Brake Edition 2020 AMG '
          'Line',
 'transmission': 'automatic',
 'trim': 'Edition 2020 AMG Line',
 'year': 2021}
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP76328%27 HTTP/1.1" 200 None
2026-03-30 09:06:47 [auto1.it] INFO: Saving data for DP76328: {'auction_closing_time': 1774884027.0, 'created_time': 1771882570.366736, 'last_price_update_time': 1774861607.055849}
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP76328') HTTP/1.1" 204 0
2026-03-30 09:06:47 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-03-30 09:06:47 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-03-30 09:06:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:06:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 09:06:47 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-03-30 09:06:47 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:03:27 13:10:20\x00'
2026-03-30 09:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6e061bf010>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb2%252Fb8b2c98c4266169d1f5b46d189d259f1%252Fpa%252FET82005_911a8863b12291f43d81c597a33113c7.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_911a8863b12291f43d81c597a33113c7.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a92a8841-4506-572a-b43e-dc02d7306fd8
2026-03-30 09:06:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a92a8841-4506-572a-b43e-dc02d7306fd8, skipping ID generation
2026-03-30 09:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a92a8841-4506-572a-b43e-dc02d7306fd8 with scrape type 1
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a92a8841-4506-572a-b43e-dc02d7306fd8 sending to next pipeline
2026-03-30 09:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a92a8841-4506-572a-b43e-dc02d7306fd8, identifier: ET82005
2026-03-30 09:06:47 [auto1.it] INFO: Found listing with ID: UY83511
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY83511%27 HTTP/1.1" 200 None
2026-03-30 09:06:47 [auto1.it] INFO: Scrape type for UY83511: 2
2026-03-30 09:06:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f07ca72-9d81-5ddd-8789-c5e0ab57a48a with identifier: UY83511
2026-03-30 09:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f07ca72-9d81-5ddd-8789-c5e0ab57a48a with scrape type 2
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f07ca72-9d81-5ddd-8789-c5e0ab57a48a with scrape type 2
2026-03-30 09:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f07ca72-9d81-5ddd-8789-c5e0ab57a48a, identifier: UY83511
2026-03-30 09:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a92a8841-4506-572a-b43e-dc02d7306fd8 with identifier: ET82005
2026-03-30 09:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a92a8841-4506-572a-b43e-dc02d7306fd8 with identifier: ET82005
2026-03-30 09:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a92a8841-4506-572a-b43e-dc02d7306fd8 with identifier: ET82005 to the API
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_911a8863b12291f43d81c597a33113c7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:06:45Z',
 'fuel_type': 'diesel',
 'id': 'a92a8841-4506-572a-b43e-dc02d7306fd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET82005',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 140917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_e9a9cb07030b6801c6381d9cd26a832a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_c50438b79cb07ae02c65e070a1582e71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_59e10c1b54ca6988ebaa881c5c68e365.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_c95ab401246206f997cd21b9495549ff.jpg',
             'Width': 668},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_ade4108add2bdcd2734c272ddbb9e253.jpg',
             'Width': 719},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_12ef038b61439c9166f79763e97c437c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_77c707f3c5b76d5283f61dee2333112d.jpg',
             'Width': 603},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 936015,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_911a8863b12291f43d81c597a33113c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_2218e5e7100b6d8ef7905c177dfe7b44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a92a8841-4506-572a-b43e-dc02d7306fd8/a92a8841-4506-572a-b43e-dc02d7306fd8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b2/b8b2c98c4266169d1f5b46d189d259f1/pa/ET82005_b8eccead51bbf4d890fbd237f2b99f1e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET82005%27 HTTP/1.1" 200 None
2026-03-30 09:06:47 [auto1.it] INFO: Saving data for ET82005: {'created_time': 1774861607.847418, 'last_price_update_time': 1774861607.847428, 'auction_closing_time': 1774969605.0}
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET82005') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f07ca72-9d81-5ddd-8789-c5e0ab57a48a with identifier: UY83511
2026-03-30 09:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f07ca72-9d81-5ddd-8789-c5e0ab57a48a with identifier: UY83511
2026-03-30 09:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f07ca72-9d81-5ddd-8789-c5e0ab57a48a with identifier: UY83511 to the API
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:53:52Z',
 'fuel_type': 'petrol',
 'id': '8f07ca72-9d81-5ddd-8789-c5e0ab57a48a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY83511',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 64023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-30',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2019}
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY83511%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [auto1.it] INFO: Saving data for UY83511: {'auction_closing_time': 1774886032.0, 'created_time': 1773139157.470155, 'last_price_update_time': 1774861608.212935}
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UY83511') HTTP/1.1" 204 0
2026-03-30 09:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efee0d84-1956-555e-b62c-5bdf26345b88 with identifier: LY93977
2026-03-30 09:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efee0d84-1956-555e-b62c-5bdf26345b88 with scrape type 1
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efee0d84-1956-555e-b62c-5bdf26345b88
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fd3%252Ff4d39508ff0270e773440d0ba25abeca%252Fpa%252FLY93977_71faa49fbf527bf1a6ee4b73ad5c3ce4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_71faa49fbf527bf1a6ee4b73ad5c3ce4.jpg already downloaded
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fd3%252Ff4d39508ff0270e773440d0ba25abeca%252Fpa%252FLY93977_d0be2bdd069ee986a2a7392d0120f822.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_d0be2bdd069ee986a2a7392d0120f822.jpg already downloaded
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fd3%252Ff4d39508ff0270e773440d0ba25abeca%252Fpa%252FLY93977_3f1c2c07b9d2d61aa01dbf79735fa179.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_3f1c2c07b9d2d61aa01dbf79735fa179.jpg already downloaded
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fd3%252Ff4d39508ff0270e773440d0ba25abeca%252Fpa%252FLY93977_942ccd3ceb5157cc922564619de27141.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_942ccd3ceb5157cc922564619de27141.jpg already downloaded
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fd3%252Ff4d39508ff0270e773440d0ba25abeca%252Fpa%252FLY93977_b838a49dda6097a300e8ff31a0b90d5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_b838a49dda6097a300e8ff31a0b90d5b.jpg already downloaded
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fd3%252Ff4d39508ff0270e773440d0ba25abeca%252Fpa%252FLY93977_cccd0be2c58cc75f9ffb464d5f1c97d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_cccd0be2c58cc75f9ffb464d5f1c97d0.jpg already downloaded
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fd3%252Ff4d39508ff0270e773440d0ba25abeca%252Fpa%252FLY93977_129cb68fdffd9400a140be4b6edec714.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_129cb68fdffd9400a140be4b6edec714.jpg already downloaded
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fd3%252Ff4d39508ff0270e773440d0ba25abeca%252Fpa%252FLY93977_8f1f5569198a26726619324f9be523a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_8f1f5569198a26726619324f9be523a9.jpg already downloaded
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fd3%252Ff4d39508ff0270e773440d0ba25abeca%252Fpa%252FLY93977_40d16ce9d8f4a0e4dee925c3523e5d0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_40d16ce9d8f4a0e4dee925c3523e5d0b.jpg already downloaded
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fd3%252Ff4d39508ff0270e773440d0ba25abeca%252Fpa%252FLY93977_77e81a06068952ed41c8b2a12f4927ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_77e81a06068952ed41c8b2a12f4927ef.jpg already downloaded
2026-03-30 09:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: efee0d84-1956-555e-b62c-5bdf26345b88, identifier: LY93977
2026-03-30 09:06:48 [auto1.it] INFO: Found listing with ID: HM97674
2026-03-30 09:06:48 [auto1.it] INFO: Found listing with ID: DF59331
2026-03-30 09:06:48 [auto1.it] INFO: Found listing with ID: MR40406
2026-03-30 09:06:48 [auto1.it] INFO: Found listing with ID: KP16451
2026-03-30 09:06:48 [auto1.it] INFO: Found listing with ID: BX11314
2026-03-30 09:06:48 [auto1.it] INFO: Found listing with ID: XR19887
2026-03-30 09:06:48 [auto1.it] INFO: Found listing with ID: JZ39211
2026-03-30 09:06:48 [auto1.it] INFO: Found listing with ID: EG37801
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG37801%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [auto1.it] INFO: Scrape type for EG37801: 2
2026-03-30 09:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 870e78e5-ab23-51a8-82b1-d23cd94548cb with identifier: EG37801
2026-03-30 09:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 870e78e5-ab23-51a8-82b1-d23cd94548cb with scrape type 2
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 870e78e5-ab23-51a8-82b1-d23cd94548cb with scrape type 2
2026-03-30 09:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 870e78e5-ab23-51a8-82b1-d23cd94548cb, identifier: EG37801
2026-03-30 09:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: efee0d84-1956-555e-b62c-5bdf26345b88 with identifier: LY93977
2026-03-30 09:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: efee0d84-1956-555e-b62c-5bdf26345b88 with identifier: LY93977
2026-03-30 09:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: efee0d84-1956-555e-b62c-5bdf26345b88 with identifier: LY93977 to the API
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LY93977>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:44:40Z',
 'fuel_type': 'petrol',
 'id': 'efee0d84-1956-555e-b62c-5bdf26345b88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY93977',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 43101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_71faa49fbf527bf1a6ee4b73ad5c3ce4.jpg',
                'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_d0be2bdd069ee986a2a7392d0120f822.jpg',
                'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_3f1c2c07b9d2d61aa01dbf79735fa179.jpg',
                'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_942ccd3ceb5157cc922564619de27141.jpg',
                'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_b838a49dda6097a300e8ff31a0b90d5b.jpg',
                'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_cccd0be2c58cc75f9ffb464d5f1c97d0.jpg',
                'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_129cb68fdffd9400a140be4b6edec714.jpg',
                'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_8f1f5569198a26726619324f9be523a9.jpg',
                'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_40d16ce9d8f4a0e4dee925c3523e5d0b.jpg',
                'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_77e81a06068952ed41c8b2a12f4927ef.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0d84-1956-555e-b62c-5bdf26345b88/efee0d84-1956-555e-b62c-5bdf26345b88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2811494,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_71faa49fbf527bf1a6ee4b73ad5c3ce4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0d84-1956-555e-b62c-5bdf26345b88/efee0d84-1956-555e-b62c-5bdf26345b88_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2861594,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_d0be2bdd069ee986a2a7392d0120f822.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0d84-1956-555e-b62c-5bdf26345b88/efee0d84-1956-555e-b62c-5bdf26345b88_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2349211,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_3f1c2c07b9d2d61aa01dbf79735fa179.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0d84-1956-555e-b62c-5bdf26345b88/efee0d84-1956-555e-b62c-5bdf26345b88_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2268010,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_942ccd3ceb5157cc922564619de27141.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0d84-1956-555e-b62c-5bdf26345b88/efee0d84-1956-555e-b62c-5bdf26345b88_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_b838a49dda6097a300e8ff31a0b90d5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0d84-1956-555e-b62c-5bdf26345b88/efee0d84-1956-555e-b62c-5bdf26345b88_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2640150,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_cccd0be2c58cc75f9ffb464d5f1c97d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0d84-1956-555e-b62c-5bdf26345b88/efee0d84-1956-555e-b62c-5bdf26345b88_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2459574,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_129cb68fdffd9400a140be4b6edec714.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0d84-1956-555e-b62c-5bdf26345b88/efee0d84-1956-555e-b62c-5bdf26345b88_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2650825,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_8f1f5569198a26726619324f9be523a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0d84-1956-555e-b62c-5bdf26345b88/efee0d84-1956-555e-b62c-5bdf26345b88_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_40d16ce9d8f4a0e4dee925c3523e5d0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0d84-1956-555e-b62c-5bdf26345b88/efee0d84-1956-555e-b62c-5bdf26345b88_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2198692,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/d3/f4d39508ff0270e773440d0ba25abeca/pa/LY93977_77e81a06068952ed41c8b2a12f4927ef.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2017}
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY93977%27 HTTP/1.1" 200 None
2026-03-30 09:06:49 [auto1.it] INFO: Saving data for LY93977: {'created_time': 1774861609.244873, 'last_price_update_time': 1774861609.244883, 'auction_closing_time': 1774971880.0}
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LY93977') HTTP/1.1" 204 0
2026-03-30 09:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 870e78e5-ab23-51a8-82b1-d23cd94548cb with identifier: EG37801
2026-03-30 09:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 870e78e5-ab23-51a8-82b1-d23cd94548cb with identifier: EG37801
2026-03-30 09:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 870e78e5-ab23-51a8-82b1-d23cd94548cb with identifier: EG37801 to the API
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:37:09Z',
 'fuel_type': 'petrol',
 'id': '870e78e5-ab23-51a8-82b1-d23cd94548cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG37801',
 'listing': 'auction',
 'make': 'DR',
 'model': 'DR 3',
 'odometer': 70363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-27',
 'seller_name': None,
 'title': 'DR DR 3 1.5',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG37801%27 HTTP/1.1" 200 None
2026-03-30 09:06:49 [auto1.it] INFO: Saving data for EG37801: {'auction_closing_time': 1774885029.0, 'created_time': 1773129779.566757, 'last_price_update_time': 1774861609.723777}
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EG37801') HTTP/1.1" 204 0
2026-03-30 09:06:49 [auto1.it] INFO: Found listing with ID: HF76476
2026-03-30 09:06:49 [auto1.it] INFO: Found listing with ID: AK59444
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK59444%27 HTTP/1.1" 200 None
2026-03-30 09:06:49 [auto1.it] INFO: Scrape type for AK59444: 2
2026-03-30 09:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98dde02b-7435-5f89-84c2-2f3e346491d4 with identifier: AK59444
2026-03-30 09:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98dde02b-7435-5f89-84c2-2f3e346491d4 with scrape type 2
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98dde02b-7435-5f89-84c2-2f3e346491d4 with scrape type 2
2026-03-30 09:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 98dde02b-7435-5f89-84c2-2f3e346491d4, identifier: AK59444
2026-03-30 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 98dde02b-7435-5f89-84c2-2f3e346491d4 with identifier: AK59444
2026-03-30 09:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 98dde02b-7435-5f89-84c2-2f3e346491d4 with identifier: AK59444
2026-03-30 09:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 98dde02b-7435-5f89-84c2-2f3e346491d4 with identifier: AK59444 to the API
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 209,
 'expiration_date': '2026-03-30T15:20:31Z',
 'fuel_type': 'hybrid',
 'id': '98dde02b-7435-5f89-84c2-2f3e346491d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK59444',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 53795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-13',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Hybrid GT-Line',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2022}
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK59444%27 HTTP/1.1" 200 None
2026-03-30 09:06:50 [auto1.it] INFO: Saving data for AK59444: {'auction_closing_time': 1774884031.0, 'created_time': 1773132381.720012, 'last_price_update_time': 1774861610.283156}
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AK59444') HTTP/1.1" 204 0
2026-03-30 09:06:50 [auto1.it] INFO: Found listing with ID: BK23225
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK23225%27 HTTP/1.1" 200 None
2026-03-30 09:06:50 [auto1.it] INFO: Scrape type for BK23225: 0
2026-03-30 09:06:50 [auto1.it] INFO: Found listing with ID: TU23775
2026-03-30 09:06:50 [auto1.it] INFO: Found listing with ID: ST52943
2026-03-30 09:06:50 [auto1.it] INFO: Found listing with ID: AB43384
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB43384%27 HTTP/1.1" 200 None
2026-03-30 09:06:50 [auto1.it] INFO: Scrape type for AB43384: 0
2026-03-30 09:06:50 [auto1.it] INFO: Found listing with ID: XF42049
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF42049%27 HTTP/1.1" 200 None
2026-03-30 09:06:50 [auto1.it] INFO: Scrape type for XF42049: 2
2026-03-30 09:06:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6064aba1-2246-5fac-9713-b19f661c3fbf with identifier: XF42049
2026-03-30 09:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6064aba1-2246-5fac-9713-b19f661c3fbf with scrape type 2
2026-03-30 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6064aba1-2246-5fac-9713-b19f661c3fbf with scrape type 2
2026-03-30 09:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6064aba1-2246-5fac-9713-b19f661c3fbf, identifier: XF42049
2026-03-30 09:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6064aba1-2246-5fac-9713-b19f661c3fbf with identifier: XF42049
2026-03-30 09:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6064aba1-2246-5fac-9713-b19f661c3fbf with identifier: XF42049
2026-03-30 09:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6064aba1-2246-5fac-9713-b19f661c3fbf with identifier: XF42049 to the API
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:20:08Z',
 'fuel_type': 'petrol',
 'id': '6064aba1-2246-5fac-9713-b19f661c3fbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF42049',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 109098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-26',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2015}
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF42049%27 HTTP/1.1" 200 None
2026-03-30 09:06:50 [auto1.it] INFO: Saving data for XF42049: {'auction_closing_time': 1774884008.0, 'created_time': 1773130373.236872, 'last_price_update_time': 1774861610.997145}
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XF42049') HTTP/1.1" 204 0
2026-03-30 09:06:51 [auto1.it] INFO: Found listing with ID: CM37896
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM37896%27 HTTP/1.1" 200 None
2026-03-30 09:06:51 [auto1.it] INFO: Scrape type for CM37896: 0
2026-03-30 09:06:51 [auto1.it] INFO: Found listing with ID: NP19925
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP19925%27 HTTP/1.1" 200 None
2026-03-30 09:06:51 [auto1.it] INFO: Scrape type for NP19925: 2
2026-03-30 09:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 045e1b4f-2964-5bca-9eb6-7ce46b6e39cb with identifier: NP19925
2026-03-30 09:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 045e1b4f-2964-5bca-9eb6-7ce46b6e39cb with scrape type 2
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 045e1b4f-2964-5bca-9eb6-7ce46b6e39cb with scrape type 2
2026-03-30 09:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 045e1b4f-2964-5bca-9eb6-7ce46b6e39cb, identifier: NP19925
2026-03-30 09:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 045e1b4f-2964-5bca-9eb6-7ce46b6e39cb with identifier: NP19925
2026-03-30 09:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 045e1b4f-2964-5bca-9eb6-7ce46b6e39cb with identifier: NP19925
2026-03-30 09:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 045e1b4f-2964-5bca-9eb6-7ce46b6e39cb with identifier: NP19925 to the API
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:17:23Z',
 'fuel_type': 'diesel',
 'id': '045e1b4f-2964-5bca-9eb6-7ce46b6e39cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP19925',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 286300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP19925%27 HTTP/1.1" 200 None
2026-03-30 09:06:51 [auto1.it] INFO: Saving data for NP19925: {'auction_closing_time': 1774883843.0, 'created_time': 1771704239.898465, 'last_price_update_time': 1774861611.428174}
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NP19925') HTTP/1.1" 204 0
2026-03-30 09:06:51 [auto1.it] INFO: Channel: 24h | Page: 28 | totalHits: 3305 | hits on page: 40
2026-03-30 09:06:51 [auto1.it] INFO: Found listing with ID: VZ89804
2026-03-30 09:06:51 [auto1.it] INFO: Found listing with ID: KU20000
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU20000%27 HTTP/1.1" 200 None
2026-03-30 09:06:51 [auto1.it] INFO: Scrape type for KU20000: 0
2026-03-30 09:06:51 [auto1.it] INFO: Found listing with ID: BS34699
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS34699%27 HTTP/1.1" 200 None
2026-03-30 09:06:51 [auto1.it] INFO: Scrape type for BS34699: 0
2026-03-30 09:06:51 [auto1.it] INFO: Found listing with ID: AS57750
2026-03-30 09:06:51 [auto1.it] INFO: Found listing with ID: PW94322
2026-03-30 09:06:51 [auto1.it] INFO: Found listing with ID: FU65166
2026-03-30 09:06:51 [auto1.it] INFO: Found listing with ID: LG94393
2026-03-30 09:06:51 [auto1.it] INFO: Found listing with ID: AB09853
2026-03-30 09:06:51 [auto1.it] INFO: Found listing with ID: BL94999
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL94999%27 HTTP/1.1" 200 None
2026-03-30 09:06:51 [auto1.it] INFO: Scrape type for BL94999: 0
2026-03-30 09:06:51 [auto1.it] INFO: Found listing with ID: PE73293
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE73293%27 HTTP/1.1" 200 None
2026-03-30 09:06:51 [auto1.it] INFO: Scrape type for PE73293: 2
2026-03-30 09:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff9c3952-63de-59ea-8bb0-442c38b7a8c3 with identifier: PE73293
2026-03-30 09:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff9c3952-63de-59ea-8bb0-442c38b7a8c3 with scrape type 2
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff9c3952-63de-59ea-8bb0-442c38b7a8c3 with scrape type 2
2026-03-30 09:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff9c3952-63de-59ea-8bb0-442c38b7a8c3, identifier: PE73293
2026-03-30 09:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff9c3952-63de-59ea-8bb0-442c38b7a8c3 with identifier: PE73293
2026-03-30 09:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff9c3952-63de-59ea-8bb0-442c38b7a8c3 with identifier: PE73293
2026-03-30 09:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff9c3952-63de-59ea-8bb0-442c38b7a8c3 with identifier: PE73293 to the API
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:23:16Z',
 'fuel_type': 'diesel',
 'id': 'ff9c3952-63de-59ea-8bb0-442c38b7a8c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE73293',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 385894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2013}
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE73293%27 HTTP/1.1" 200 None
2026-03-30 09:06:51 [auto1.it] INFO: Saving data for PE73293: {'auction_closing_time': 1774884196.0, 'created_time': 1773130333.490271, 'last_price_update_time': 1774861611.92767}
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PE73293') HTTP/1.1" 204 0
2026-03-30 09:06:52 [auto1.it] INFO: Found listing with ID: LW03785
2026-03-30 09:06:52 [auto1.it] INFO: Found listing with ID: UP48367
2026-03-30 09:06:52 [auto1.it] INFO: Found listing with ID: LW86273
2026-03-30 09:06:52 [auto1.it] INFO: Found listing with ID: LY27741
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY27741%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [auto1.it] INFO: Scrape type for LY27741: 2
2026-03-30 09:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bfd2759-496a-5802-a5b9-116b47835352 with identifier: LY27741
2026-03-30 09:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bfd2759-496a-5802-a5b9-116b47835352 with scrape type 2
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bfd2759-496a-5802-a5b9-116b47835352 with scrape type 2
2026-03-30 09:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2bfd2759-496a-5802-a5b9-116b47835352, identifier: LY27741
2026-03-30 09:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2bfd2759-496a-5802-a5b9-116b47835352 with identifier: LY27741
2026-03-30 09:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2bfd2759-496a-5802-a5b9-116b47835352 with identifier: LY27741
2026-03-30 09:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2bfd2759-496a-5802-a5b9-116b47835352 with identifier: LY27741 to the API
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:27:21Z',
 'fuel_type': 'petrol',
 'id': '2bfd2759-496a-5802-a5b9-116b47835352',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY27741',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 103662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Progression',
 'transmission': 'manual',
 'trim': 'Progression',
 'year': 2015}
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY27741%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [auto1.it] INFO: Saving data for LY27741: {'auction_closing_time': 1774884441.0, 'created_time': 1772101526.63149, 'last_price_update_time': 1774861612.518736}
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LY27741') HTTP/1.1" 204 0
2026-03-30 09:06:52 [auto1.it] INFO: Found listing with ID: YA33323
2026-03-30 09:06:52 [auto1.it] INFO: Found listing with ID: TR04058
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR04058%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [auto1.it] INFO: Scrape type for TR04058: 2
2026-03-30 09:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5702d053-2a10-5418-8040-e7de1321a199 with identifier: TR04058
2026-03-30 09:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5702d053-2a10-5418-8040-e7de1321a199 with scrape type 2
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5702d053-2a10-5418-8040-e7de1321a199 with scrape type 2
2026-03-30 09:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5702d053-2a10-5418-8040-e7de1321a199, identifier: TR04058
2026-03-30 09:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5702d053-2a10-5418-8040-e7de1321a199 with identifier: TR04058
2026-03-30 09:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5702d053-2a10-5418-8040-e7de1321a199 with identifier: TR04058
2026-03-30 09:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5702d053-2a10-5418-8040-e7de1321a199 with identifier: TR04058 to the API
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:36:18Z',
 'fuel_type': 'diesel',
 'id': '5702d053-2a10-5418-8040-e7de1321a199',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR04058',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 252477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR04058%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [auto1.it] INFO: Saving data for TR04058: {'auction_closing_time': 1774884978.0, 'created_time': 1771704043.595425, 'last_price_update_time': 1774861612.973898}
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TR04058') HTTP/1.1" 204 0
2026-03-30 09:06:53 [auto1.it] INFO: Found listing with ID: NC94766
2026-03-30 09:06:53 [auto1.it] INFO: Found listing with ID: UC76692
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC76692%27 HTTP/1.1" 200 None
2026-03-30 09:06:53 [auto1.it] INFO: Scrape type for UC76692: 2
2026-03-30 09:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54d009ac-2904-59fa-b1d0-538be1db39db with identifier: UC76692
2026-03-30 09:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d009ac-2904-59fa-b1d0-538be1db39db with scrape type 2
2026-03-30 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54d009ac-2904-59fa-b1d0-538be1db39db with scrape type 2
2026-03-30 09:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54d009ac-2904-59fa-b1d0-538be1db39db, identifier: UC76692
2026-03-30 09:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54d009ac-2904-59fa-b1d0-538be1db39db with identifier: UC76692
2026-03-30 09:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54d009ac-2904-59fa-b1d0-538be1db39db with identifier: UC76692
2026-03-30 09:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54d009ac-2904-59fa-b1d0-538be1db39db with identifier: UC76692 to the API
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:58:04Z',
 'fuel_type': 'diesel',
 'id': '54d009ac-2904-59fa-b1d0-538be1db39db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC76692',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 133736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-18',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 e-HDi Intensive',
 'transmission': 'automatic',
 'trim': 'Intensive',
 'year': 2014}
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC76692%27 HTTP/1.1" 200 None
2026-03-30 09:06:53 [auto1.it] INFO: Saving data for UC76692: {'auction_closing_time': 1774886284.0, 'created_time': 1771704543.448006, 'last_price_update_time': 1774861613.483123}
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UC76692') HTTP/1.1" 204 0
2026-03-30 09:06:53 [auto1.it] INFO: Found listing with ID: NT59940
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT59940%27 HTTP/1.1" 200 None
2026-03-30 09:06:53 [auto1.it] INFO: Scrape type for NT59940: 2
2026-03-30 09:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60de554d-4741-55eb-9853-b739c6461918 with identifier: NT59940
2026-03-30 09:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60de554d-4741-55eb-9853-b739c6461918 with scrape type 2
2026-03-30 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60de554d-4741-55eb-9853-b739c6461918 with scrape type 2
2026-03-30 09:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 60de554d-4741-55eb-9853-b739c6461918, identifier: NT59940
2026-03-30 09:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 60de554d-4741-55eb-9853-b739c6461918 with identifier: NT59940
2026-03-30 09:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 60de554d-4741-55eb-9853-b739c6461918 with identifier: NT59940
2026-03-30 09:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 60de554d-4741-55eb-9853-b739c6461918 with identifier: NT59940 to the API
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:15:47Z',
 'fuel_type': 'diesel',
 'id': '60de554d-4741-55eb-9853-b739c6461918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT59940',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 197258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-11-12',
 'seller_name': None,
 'title': 'Volkswagen Touareg 2.5 TDI R5',
 'transmission': 'automatic',
 'trim': 'R5',
 'year': 2003}
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT59940%27 HTTP/1.1" 200 None
2026-03-30 09:06:53 [auto1.it] INFO: Saving data for NT59940: {'auction_closing_time': 1774883747.0, 'created_time': 1772174772.903549, 'last_price_update_time': 1774861613.967395}
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NT59940') HTTP/1.1" 204 0
2026-03-30 09:06:53 [auto1.it] INFO: Found listing with ID: KM64603
2026-03-30 09:06:53 [auto1.it] INFO: Found listing with ID: PA30121
2026-03-30 09:06:53 [auto1.it] INFO: Found listing with ID: ZY33580
2026-03-30 09:06:53 [auto1.it] INFO: Found listing with ID: YJ83729
2026-03-30 09:06:53 [auto1.it] INFO: Found listing with ID: WL70343
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL70343%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [auto1.it] INFO: Scrape type for WL70343: 0
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: DT89557
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT89557%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [auto1.it] INFO: Scrape type for DT89557: 0
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: VK83291
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK83291%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [auto1.it] INFO: Scrape type for VK83291: 0
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: FR55609
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: CV87912
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: MU13564
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: PY58212
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: NX47141
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: SC24235
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: WL97433
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL97433%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [auto1.it] INFO: Scrape type for WL97433: 0
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: NL26741
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: CR51689
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR51689%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [auto1.it] INFO: Scrape type for CR51689: 0
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: PE19282
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE19282%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [auto1.it] INFO: Scrape type for PE19282: 0
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: LP93747
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP93747%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [auto1.it] INFO: Scrape type for LP93747: 0
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: RA56260
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: EK01014
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: ZH89782
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: YS46644
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: RC57618
2026-03-30 09:06:54 [auto1.it] INFO: Found listing with ID: RZ13611
2026-03-30 09:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:02 [auto1.it] INFO: Channel: 24h | Page: 29 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: TD94995
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD94995%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Scrape type for TD94995: 0
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: EW86248
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: WB67715
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: ZK23412
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK23412%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Scrape type for ZK23412: 0
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: KT97112
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT97112%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Scrape type for KT97112: 0
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: VX54409
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: XH11814
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: KN64287
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: JM92552
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM92552%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Scrape type for JM92552: 0
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: HP20595
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP20595%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Scrape type for HP20595: 0
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: RF53509
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: VY56093
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY56093%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Scrape type for VY56093: 0
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: XS81991
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS81991%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Scrape type for XS81991: 0
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: KL09391
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL09391%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Scrape type for KL09391: 0
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: DH11119
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH11119%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Scrape type for DH11119: 0
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: VL58331
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL58331%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Scrape type for VL58331: 0
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: MW24611
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW24611%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Scrape type for MW24611: 0
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: WJ42513
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: RX80413
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: JK04484
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK04484%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Scrape type for JK04484: 0
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: ZE02722
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: PA82276
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: XE77432
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: BG27865
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG27865%27 HTTP/1.1" 200 None
2026-03-30 09:07:03 [auto1.it] INFO: Scrape type for BG27865: 0
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: EK32086
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK32086%27 HTTP/1.1" 200 None
2026-03-30 09:07:03 [auto1.it] INFO: Scrape type for EK32086: 0
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: VN61969
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: RH32617
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: TJ05076
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ05076%27 HTTP/1.1" 200 None
2026-03-30 09:07:03 [auto1.it] INFO: Scrape type for TJ05076: 0
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: PZ73460
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: TY12720
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY12720%27 HTTP/1.1" 200 None
2026-03-30 09:07:03 [auto1.it] INFO: Scrape type for TY12720: 0
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: RS94831
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS94831%27 HTTP/1.1" 200 None
2026-03-30 09:07:03 [auto1.it] INFO: Scrape type for RS94831: 0
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: BZ50824
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: TW69168
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW69168%27 HTTP/1.1" 200 None
2026-03-30 09:07:03 [auto1.it] INFO: Scrape type for TW69168: 0
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: XK06732
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK06732%27 HTTP/1.1" 200 None
2026-03-30 09:07:03 [auto1.it] INFO: Scrape type for XK06732: 0
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: CE45515
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: SY67891
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY67891%27 HTTP/1.1" 200 None
2026-03-30 09:07:03 [auto1.it] INFO: Scrape type for SY67891: 0
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: WE05863
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE05863%27 HTTP/1.1" 200 None
2026-03-30 09:07:03 [auto1.it] INFO: Scrape type for WE05863: 0
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: KR29976
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR29976%27 HTTP/1.1" 200 None
2026-03-30 09:07:03 [auto1.it] INFO: Scrape type for KR29976: 0
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: ES96782
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES96782%27 HTTP/1.1" 200 None
2026-03-30 09:07:03 [auto1.it] INFO: Scrape type for ES96782: 0
2026-03-30 09:07:03 [auto1.it] INFO: Found listing with ID: PU50365
2026-03-30 09:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:04 [scrapy.extensions.logstats] INFO: Crawled 261 pages (at 13 pages/min), scraped 511 items (at 70 items/min)
2026-03-30 09:07:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 198MiB
2026-03-30 09:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:04 [auto1.it] INFO: Channel: 24h | Page: 30 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: NP45555
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: LE11885
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: EW80133
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: DB86833
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB86833%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for DB86833: 0
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: VF83639
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: JP63485
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP63485%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for JP63485: 0
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: PE22085
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE22085%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for PE22085: 0
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: AC12689
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC12689%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for AC12689: 0
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: KK08991
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: NJ15500
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ15500%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for NJ15500: 0
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: JU37769
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU37769%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for JU37769: 0
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: LA80285
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA80285%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for LA80285: 0
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: LM41534
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: UK25874
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: PB14031
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB14031%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for PB14031: 0
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: LV20949
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: US42109
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US42109%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for US42109: 0
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: YD46190
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: BP59545
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP59545%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for BP59545: 0
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: WL47610
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL47610%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for WL47610: 0
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: TE89149
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE89149%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for TE89149: 2
2026-03-30 09:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8abe93f-5bb1-56e6-94b0-e48f90b4b603 with identifier: TE89149
2026-03-30 09:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8abe93f-5bb1-56e6-94b0-e48f90b4b603 with scrape type 2
2026-03-30 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8abe93f-5bb1-56e6-94b0-e48f90b4b603 with scrape type 2
2026-03-30 09:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c8abe93f-5bb1-56e6-94b0-e48f90b4b603, identifier: TE89149
2026-03-30 09:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c8abe93f-5bb1-56e6-94b0-e48f90b4b603 with identifier: TE89149
2026-03-30 09:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c8abe93f-5bb1-56e6-94b0-e48f90b4b603 with identifier: TE89149
2026-03-30 09:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c8abe93f-5bb1-56e6-94b0-e48f90b4b603 with identifier: TE89149 to the API
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:01:23Z',
 'fuel_type': 'petrol',
 'id': 'c8abe93f-5bb1-56e6-94b0-e48f90b4b603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE89149',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 115166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2015}
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE89149%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Saving data for TE89149: {'auction_closing_time': 1774882883.0, 'created_time': 1774559119.694497, 'last_price_update_time': 1774861625.153466}
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TE89149') HTTP/1.1" 204 0
2026-03-30 09:07:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: KR30691
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR30691%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Scrape type for KR30691: 0
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: TJ46359
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ46359%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Scrape type for TJ46359: 0
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: WV37243
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: LU63689
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU63689%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Scrape type for LU63689: 0
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: FJ55026
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ55026%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Scrape type for FJ55026: 0
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: GW87454
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW87454%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Scrape type for GW87454: 0
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: PH50557
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH50557%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Scrape type for PH50557: 0
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: ZU90701
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU90701%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Scrape type for ZU90701: 0
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: JV01871
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV01871%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Scrape type for JV01871: 0
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: FS14402
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS14402%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Scrape type for FS14402: 0
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: WK43313
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: UV07226
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: DB68692
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB68692%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Scrape type for DB68692: 0
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: DC45028
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: BD73790
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: SL28261
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: XC65612
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC65612%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Scrape type for XC65612: 0
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: YD99116
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: PH70338
2026-03-30 09:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:06 [auto1.it] INFO: Channel: 24h | Page: 31 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: XC79515
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: RS77350
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: NK56802
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK56802%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for NK56802: 0
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: ET21203
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: BG99585
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: HZ70208
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: JP32854
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: FV19054
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: VX82839
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX82839%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for VX82839: 0
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: PT96186
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT96186%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for PT96186: 0
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: PA28005
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA28005%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for PA28005: 0
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: KC73163
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: MN68461
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN68461%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for MN68461: 0
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: YA54300
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: UJ66117
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: RE99850
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: JP92326
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: CU15371
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: AB01371
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: XB62766
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB62766%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for XB62766: 0
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: TU59296
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: FN81856
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN81856%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for FN81856: 0
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: AD01687
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD01687%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for AD01687: 0
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: RM66107
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: CK86990
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: AY12786
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY12786%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for AY12786: 0
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: XD81326
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: ED09945
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED09945%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for ED09945: 0
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: LK74969
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: PW94940
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: UH56050
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: VX86460
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX86460%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for VX86460: 0
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: WE55630
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: LF91623
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: XT06455
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: DD62614
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: BA90157
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA90157%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for BA90157: 0
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: AB06670
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB06670%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for AB06670: 2
2026-03-30 09:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90c5136c-6146-566a-b1be-13a946ef6083 with identifier: AB06670
2026-03-30 09:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90c5136c-6146-566a-b1be-13a946ef6083 with scrape type 2
2026-03-30 09:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90c5136c-6146-566a-b1be-13a946ef6083 with scrape type 2
2026-03-30 09:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 90c5136c-6146-566a-b1be-13a946ef6083, identifier: AB06670
2026-03-30 09:07:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 90c5136c-6146-566a-b1be-13a946ef6083 with identifier: AB06670
2026-03-30 09:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 90c5136c-6146-566a-b1be-13a946ef6083 with identifier: AB06670
2026-03-30 09:07:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 90c5136c-6146-566a-b1be-13a946ef6083 with identifier: AB06670 to the API
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:02Z',
 'fuel_type': 'diesel',
 'id': '90c5136c-6146-566a-b1be-13a946ef6083',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB06670',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 187047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-19',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2017}
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB06670%27 HTTP/1.1" 200 None
2026-03-30 09:07:07 [auto1.it] INFO: Saving data for AB06670: {'auction_closing_time': 1774884302.0, 'created_time': 1774558999.498043, 'last_price_update_time': 1774861627.057469}
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AB06670') HTTP/1.1" 204 0
2026-03-30 09:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:07 [auto1.it] INFO: Found listing with ID: LV99150
2026-03-30 09:07:07 [auto1.it] INFO: Found listing with ID: VC44140
2026-03-30 09:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:08 [auto1.it] INFO: Channel: 24h | Page: 32 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: KV39692
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV39692%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for KV39692: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: UL45556
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL45556%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for UL45556: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: LM08573
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM08573%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for LM08573: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: SG91000
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: JP22966
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP22966%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for JP22966: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: AA32249
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: YV19719
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: CK12538
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK12538%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for CK12538: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: PW56521
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW56521%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for PW56521: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: CX68845
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX68845%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for CX68845: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: SV37675
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV37675%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for SV37675: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: BF69187
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF69187%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for BF69187: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: ZZ46834
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: EV65529
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: YW82008
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: TH21432
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH21432%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for TH21432: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: MH72386
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: CR81411
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR81411%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for CR81411: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: YF20115
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF20115%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for YF20115: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: NN80859
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN80859%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for NN80859: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: CX56381
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: FB75949
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: JA23612
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA23612%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for JA23612: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: EM60693
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM60693%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for EM60693: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: LC51604
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: UK70353
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: KM71175
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM71175%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for KM71175: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: AE34833
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE34833%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for AE34833: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: PB29949
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB29949%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for PB29949: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: AU35917
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: DR37659
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: WY72750
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY72750%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for WY72750: 0
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: LC01017
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: MW60739
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: XH41983
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: RR03246
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: HY79670
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: EC99785
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: MB50671
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: JF90456
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF90456%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for JF90456: 0
2026-03-30 09:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:16 [auto1.it] INFO: Channel: 24h | Page: 33 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:16 [auto1.it] INFO: Found listing with ID: LL94615
2026-03-30 09:07:16 [auto1.it] INFO: Found listing with ID: WZ44056
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ44056%27 HTTP/1.1" 200 None
2026-03-30 09:07:16 [auto1.it] INFO: Scrape type for WZ44056: 0
2026-03-30 09:07:16 [auto1.it] INFO: Found listing with ID: DC03945
2026-03-30 09:07:16 [auto1.it] INFO: Found listing with ID: BH62739
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH62739%27 HTTP/1.1" 200 None
2026-03-30 09:07:16 [auto1.it] INFO: Scrape type for BH62739: 0
2026-03-30 09:07:16 [auto1.it] INFO: Found listing with ID: LR71348
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR71348%27 HTTP/1.1" 200 None
2026-03-30 09:07:16 [auto1.it] INFO: Scrape type for LR71348: 0
2026-03-30 09:07:16 [auto1.it] INFO: Found listing with ID: ML20734
2026-03-30 09:07:16 [auto1.it] INFO: Found listing with ID: HC48656
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC48656%27 HTTP/1.1" 200 None
2026-03-30 09:07:16 [auto1.it] INFO: Scrape type for HC48656: 0
2026-03-30 09:07:16 [auto1.it] INFO: Found listing with ID: CZ22961
2026-03-30 09:07:17 [auto1.it] INFO: Found listing with ID: RM05411
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM05411%27 HTTP/1.1" 200 None
2026-03-30 09:07:17 [auto1.it] INFO: Scrape type for RM05411: 0
2026-03-30 09:07:17 [auto1.it] INFO: Found listing with ID: VS31933
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS31933%27 HTTP/1.1" 200 None
2026-03-30 09:07:17 [auto1.it] INFO: Scrape type for VS31933: 2
2026-03-30 09:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2e910fc-f5be-52e1-a01e-96f121d31a0e with identifier: VS31933
2026-03-30 09:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2e910fc-f5be-52e1-a01e-96f121d31a0e with scrape type 2
2026-03-30 09:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2e910fc-f5be-52e1-a01e-96f121d31a0e with scrape type 2
2026-03-30 09:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f2e910fc-f5be-52e1-a01e-96f121d31a0e, identifier: VS31933
2026-03-30 09:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f2e910fc-f5be-52e1-a01e-96f121d31a0e with identifier: VS31933
2026-03-30 09:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f2e910fc-f5be-52e1-a01e-96f121d31a0e with identifier: VS31933
2026-03-30 09:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f2e910fc-f5be-52e1-a01e-96f121d31a0e with identifier: VS31933 to the API
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:51Z',
 'fuel_type': 'petrol',
 'id': 'f2e910fc-f5be-52e1-a01e-96f121d31a0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS31933',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 130217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2015}
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS31933%27 HTTP/1.1" 200 None
2026-03-30 09:07:17 [auto1.it] INFO: Saving data for VS31933: {'auction_closing_time': 1774883511.0, 'created_time': 1774559036.268661, 'last_price_update_time': 1774861637.43188}
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VS31933') HTTP/1.1" 204 0
2026-03-30 09:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:17 [auto1.it] INFO: Found listing with ID: ZC19416
2026-03-30 09:07:17 [auto1.it] INFO: Found listing with ID: GN54162
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN54162%27 HTTP/1.1" 200 None
2026-03-30 09:07:17 [auto1.it] INFO: Scrape type for GN54162: 0
2026-03-30 09:07:17 [auto1.it] INFO: Found listing with ID: DE25222
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE25222%27 HTTP/1.1" 200 None
2026-03-30 09:07:17 [auto1.it] INFO: Scrape type for DE25222: 2
2026-03-30 09:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56c5674c-36ec-57cc-933c-5d19a49c7a79 with identifier: DE25222
2026-03-30 09:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56c5674c-36ec-57cc-933c-5d19a49c7a79 with scrape type 2
2026-03-30 09:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56c5674c-36ec-57cc-933c-5d19a49c7a79 with scrape type 2
2026-03-30 09:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 56c5674c-36ec-57cc-933c-5d19a49c7a79, identifier: DE25222
2026-03-30 09:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 56c5674c-36ec-57cc-933c-5d19a49c7a79 with identifier: DE25222
2026-03-30 09:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 56c5674c-36ec-57cc-933c-5d19a49c7a79 with identifier: DE25222
2026-03-30 09:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 56c5674c-36ec-57cc-933c-5d19a49c7a79 with identifier: DE25222 to the API
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:24:07Z',
 'fuel_type': 'diesel',
 'id': '56c5674c-36ec-57cc-933c-5d19a49c7a79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE25222',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 172465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-16',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Cosmo',
 'transmission': 'automatic',
 'trim': 'Cosmo',
 'year': 2014}
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE25222%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Saving data for DE25222: {'auction_closing_time': 1774884247.0, 'created_time': 1774559186.537407, 'last_price_update_time': 1774861638.009355}
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DE25222') HTTP/1.1" 204 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: YL89014
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL89014%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for YL89014: 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: MA77848
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: CF61926
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: HD82423
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: MU03817
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU03817%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for MU03817: 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: ZS54460
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS54460%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for ZS54460: 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: AY21125
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: NW60366
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: XR42745
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR42745%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for XR42745: 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: WV42889
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: UE31204
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE31204%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for UE31204: 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: KD02463
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD02463%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for KD02463: 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: SL86512
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: EZ48642
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: BM42520
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM42520%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for BM42520: 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: SG31590
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG31590%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for SG31590: 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: DN82434
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: AN97971
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN97971%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for AN97971: 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: FP35914
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: RK20934
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK20934%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for RK20934: 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: ZY56429
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY56429%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for ZY56429: 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: XN27965
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN27965%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for XN27965: 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: VF40015
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF40015%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for VF40015: 0
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: EC84941
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: JJ80566
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: RL33082
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: EB44431
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB44431%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for EB44431: 0
2026-03-30 09:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:19 [auto1.it] INFO: Channel: 24h | Page: 34 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: JF75950
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: WX88611
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: FA16942
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: NH64941
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH64941%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for NH64941: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: KS43685
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: FE11339
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE11339%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for FE11339: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: TS34792
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS34792%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for TS34792: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: RY64752
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: CS00409
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS00409%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for CS00409: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: ET79230
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET79230%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for ET79230: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: HD95534
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD95534%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for HD95534: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: KL55117
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL55117%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for KL55117: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: CH57446
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: KB12646
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: NC67394
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: ZD65765
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD65765%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for ZD65765: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: WM00919
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: UR83709
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: XJ91749
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: RZ16714
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ16714%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for RZ16714: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: JB13262
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: TU38446
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: AR28136
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: EV19228
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: CN88471
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN88471%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for CN88471: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: XX59557
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX59557%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for XX59557: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: EH45262
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: BV63915
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: TH28502
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH28502%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for TH28502: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: KS79524
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS79524%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for KS79524: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: JU83939
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: CN85628
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN85628%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for CN85628: 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: WD53289
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD53289%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for WD53289: 2
2026-03-30 09:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b140ffad-09f3-57dc-8e28-3279a0d41661 with identifier: WD53289
2026-03-30 09:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b140ffad-09f3-57dc-8e28-3279a0d41661 with scrape type 2
2026-03-30 09:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b140ffad-09f3-57dc-8e28-3279a0d41661 with scrape type 2
2026-03-30 09:07:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b140ffad-09f3-57dc-8e28-3279a0d41661, identifier: WD53289
2026-03-30 09:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b140ffad-09f3-57dc-8e28-3279a0d41661 with identifier: WD53289
2026-03-30 09:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b140ffad-09f3-57dc-8e28-3279a0d41661 with identifier: WD53289
2026-03-30 09:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b140ffad-09f3-57dc-8e28-3279a0d41661 with identifier: WD53289 to the API
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:47:04Z',
 'fuel_type': 'petrol',
 'id': 'b140ffad-09f3-57dc-8e28-3279a0d41661',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD53289',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 95800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-04',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2019}
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD53289%27 HTTP/1.1" 200 None
2026-03-30 09:07:20 [auto1.it] INFO: Saving data for WD53289: {'auction_closing_time': 1774885624.0, 'created_time': 1774559142.119032, 'last_price_update_time': 1774861640.232599}
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WD53289') HTTP/1.1" 204 0
2026-03-30 09:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:20 [auto1.it] INFO: Found listing with ID: SE27388
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE27388%27 HTTP/1.1" 200 None
2026-03-30 09:07:20 [auto1.it] INFO: Scrape type for SE27388: 0
2026-03-30 09:07:20 [auto1.it] INFO: Found listing with ID: FT94062
2026-03-30 09:07:20 [auto1.it] INFO: Found listing with ID: NX73202
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX73202%27 HTTP/1.1" 200 None
2026-03-30 09:07:20 [auto1.it] INFO: Scrape type for NX73202: 0
2026-03-30 09:07:20 [auto1.it] INFO: Found listing with ID: DV90531
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV90531%27 HTTP/1.1" 200 None
2026-03-30 09:07:20 [auto1.it] INFO: Scrape type for DV90531: 0
2026-03-30 09:07:20 [auto1.it] INFO: Found listing with ID: PW65105
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW65105%27 HTTP/1.1" 200 None
2026-03-30 09:07:20 [auto1.it] INFO: Scrape type for PW65105: 0
2026-03-30 09:07:20 [auto1.it] INFO: Found listing with ID: TT80777
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT80777%27 HTTP/1.1" 200 None
2026-03-30 09:07:20 [auto1.it] INFO: Scrape type for TT80777: 0
2026-03-30 09:07:20 [auto1.it] INFO: Found listing with ID: BR63865
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR63865%27 HTTP/1.1" 200 None
2026-03-30 09:07:20 [auto1.it] INFO: Scrape type for BR63865: 0
2026-03-30 09:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:21 [auto1.it] INFO: Channel: 24h | Page: 35 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: LX11958
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: PA53057
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: XW51036
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW51036%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Scrape type for XW51036: 0
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: RJ33574
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ33574%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Scrape type for RJ33574: 0
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: DW12322
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: RT39388
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT39388%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Scrape type for RT39388: 0
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: ET07404
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET07404%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Scrape type for ET07404: 0
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: ZR50624
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR50624%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Scrape type for ZR50624: 0
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: GM86126
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: WH19380
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH19380%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Scrape type for WH19380: 0
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: GF15997
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: MS58907
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS58907%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Scrape type for MS58907: 0
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: DA24771
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA24771%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Scrape type for DA24771: 0
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: LE49462
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE49462%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Scrape type for LE49462: 0
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: LR70211
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR70211%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Scrape type for LR70211: 0
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: AL22636
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: JT08977
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT08977%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Scrape type for JT08977: 0
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: MF61265
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: ZX69560
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: ZC80598
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC80598%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Scrape type for ZC80598: 0
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: EG89993
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: CB33793
2026-03-30 09:07:21 [auto1.it] INFO: Found listing with ID: KJ52341
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ52341%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Scrape type for KJ52341: 2
2026-03-30 09:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adc7ddfb-fc3f-5fe7-86e3-c3703754ee9e with identifier: KJ52341
2026-03-30 09:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adc7ddfb-fc3f-5fe7-86e3-c3703754ee9e with scrape type 2
2026-03-30 09:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adc7ddfb-fc3f-5fe7-86e3-c3703754ee9e with scrape type 2
2026-03-30 09:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: adc7ddfb-fc3f-5fe7-86e3-c3703754ee9e, identifier: KJ52341
2026-03-30 09:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: adc7ddfb-fc3f-5fe7-86e3-c3703754ee9e with identifier: KJ52341
2026-03-30 09:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: adc7ddfb-fc3f-5fe7-86e3-c3703754ee9e with identifier: KJ52341
2026-03-30 09:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: adc7ddfb-fc3f-5fe7-86e3-c3703754ee9e with identifier: KJ52341 to the API
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:19:04Z',
 'fuel_type': 'diesel',
 'id': 'adc7ddfb-fc3f-5fe7-86e3-c3703754ee9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ52341',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 127944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-07',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 200 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ52341%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [auto1.it] INFO: Saving data for KJ52341: {'auction_closing_time': 1774883944.0, 'created_time': 1774558976.997281, 'last_price_update_time': 1774861642.337642}
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KJ52341') HTTP/1.1" 204 0
2026-03-30 09:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: MH68095
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: DN48840
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN48840%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [auto1.it] INFO: Scrape type for DN48840: 0
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: KD49699
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD49699%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [auto1.it] INFO: Scrape type for KD49699: 0
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: HC25835
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: VZ70094
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ70094%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [auto1.it] INFO: Scrape type for VZ70094: 0
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: FZ95983
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ95983%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [auto1.it] INFO: Scrape type for FZ95983: 0
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: KR95959
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR95959%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [auto1.it] INFO: Scrape type for KR95959: 0
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: RD83320
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: GP15834
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP15834%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [auto1.it] INFO: Scrape type for GP15834: 0
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: KD20323
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: HP12790
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP12790%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [auto1.it] INFO: Scrape type for HP12790: 0
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: KT78402
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: TZ23741
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: XT36875
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: ZL03111
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL03111%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [auto1.it] INFO: Scrape type for ZL03111: 0
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: NC12493
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: TL13450
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL13450%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [auto1.it] INFO: Scrape type for TL13450: 0
2026-03-30 09:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:23 [auto1.it] INFO: Channel: 24h | Page: 36 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: ZP73975
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: BT65910
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: AY77506
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: TW94655
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW94655%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for TW94655: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: ED22447
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: KZ49625
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: XM03029
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM03029%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for XM03029: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: PZ63395
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: TY62021
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: CW24266
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: LX97199
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX97199%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for LX97199: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: BR49145
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: CT62115
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: ND06570
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: FX03621
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: BX57696
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX57696%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for BX57696: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: SS09351
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: PW70389
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: DA57942
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA57942%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for DA57942: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: MJ97902
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: EZ75087
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ75087%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for EZ75087: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: BR31613
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: FH51436
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: FX08227
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: AU78491
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: ST39288
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST39288%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for ST39288: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: ZY63215
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: TH24600
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: HD23157
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD23157%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for HD23157: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: EA21012
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA21012%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for EA21012: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: JZ39412
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ39412%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for JZ39412: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: UD54750
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: GN89134
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN89134%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for GN89134: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: SP76824
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: TU52552
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU52552%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for TU52552: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: NT95206
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT95206%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for NT95206: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: LK41226
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: UC24034
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC24034%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for UC24034: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: ZW62743
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW62743%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for ZW62743: 0
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: SK49323
2026-03-30 09:07:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:28 [auto1.it] INFO: Channel: 24h | Page: 37 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: YG84271
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: MZ19905
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ19905%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for MZ19905: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: DW53696
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: SF43415
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF43415%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for SF43415: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: SV52525
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV52525%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for SV52525: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: HG71843
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: VX04337
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX04337%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for VX04337: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: NF97325
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF97325%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for NF97325: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: DD82932
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: SY54017
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY54017%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for SY54017: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: FK85417
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: RN99841
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: CP55584
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: GK72900
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: JR96571
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: YZ66981
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ66981%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for YZ66981: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: FR96632
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR96632%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for FR96632: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: TU01190
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU01190%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for TU01190: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: HE91199
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE91199%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for HE91199: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: YG22381
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG22381%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for YG22381: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: CK25903
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK25903%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for CK25903: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: XN45534
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: EC13131
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: CS14469
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: VR70375
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: WS86957
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS86957%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for WS86957: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: NC51724
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC51724%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for NC51724: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: BE49358
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE49358%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for BE49358: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: BD99197
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: EN53386
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: LX30829
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX30829%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for LX30829: 0
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: TJ19111
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: KX10481
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: EW42527
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: AC58297
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC58297%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for AC58297: 2
2026-03-30 09:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfe9960d-51be-5428-9857-7f7f1d12f50b with identifier: AC58297
2026-03-30 09:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfe9960d-51be-5428-9857-7f7f1d12f50b with scrape type 2
2026-03-30 09:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfe9960d-51be-5428-9857-7f7f1d12f50b with scrape type 2
2026-03-30 09:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bfe9960d-51be-5428-9857-7f7f1d12f50b, identifier: AC58297
2026-03-30 09:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bfe9960d-51be-5428-9857-7f7f1d12f50b with identifier: AC58297
2026-03-30 09:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bfe9960d-51be-5428-9857-7f7f1d12f50b with identifier: AC58297
2026-03-30 09:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bfe9960d-51be-5428-9857-7f7f1d12f50b with identifier: AC58297 to the API
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:41:33Z',
 'fuel_type': 'diesel',
 'id': 'bfe9960d-51be-5428-9857-7f7f1d12f50b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC58297',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 147565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-20',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2014}
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC58297%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Saving data for AC58297: {'auction_closing_time': 1774885293.0, 'created_time': 1774559163.340391, 'last_price_update_time': 1774861648.965467}
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AC58297') HTTP/1.1" 204 0
2026-03-30 09:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:29 [auto1.it] INFO: Found listing with ID: SK41395
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK41395%27 HTTP/1.1" 200 None
2026-03-30 09:07:29 [auto1.it] INFO: Scrape type for SK41395: 0
2026-03-30 09:07:29 [auto1.it] INFO: Found listing with ID: YD65292
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD65292%27 HTTP/1.1" 200 None
2026-03-30 09:07:29 [auto1.it] INFO: Scrape type for YD65292: 0
2026-03-30 09:07:29 [auto1.it] INFO: Found listing with ID: RG08819
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG08819%27 HTTP/1.1" 200 None
2026-03-30 09:07:29 [auto1.it] INFO: Scrape type for RG08819: 0
2026-03-30 09:07:29 [auto1.it] INFO: Found listing with ID: GB22303
2026-03-30 09:07:29 [auto1.it] INFO: Found listing with ID: VU11306
2026-03-30 09:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:30 [auto1.it] INFO: Channel: 24h | Page: 38 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: JD40027
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: KF78303
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: BH88586
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH88586%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for BH88586: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: TY97368
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: RL62360
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL62360%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for RL62360: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: LG34418
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG34418%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for LG34418: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: SK90576
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: MT68027
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT68027%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for MT68027: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: GU05332
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU05332%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for GU05332: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: AN40699
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN40699%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for AN40699: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: CK01527
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK01527%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for CK01527: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: WW70884
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: AT74871
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: BJ21664
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ21664%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for BJ21664: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: FP22884
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: SN99997
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN99997%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for SN99997: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: YL87875
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL87875%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for YL87875: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: SP92634
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP92634%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for SP92634: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: AH31892
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH31892%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for AH31892: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: FH04610
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: ZE89719
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE89719%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for ZE89719: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: RE87143
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE87143%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for RE87143: 2
2026-03-30 09:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf5016aa-86c7-58c7-8caf-d40f68706b18 with identifier: RE87143
2026-03-30 09:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5016aa-86c7-58c7-8caf-d40f68706b18 with scrape type 2
2026-03-30 09:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf5016aa-86c7-58c7-8caf-d40f68706b18 with scrape type 2
2026-03-30 09:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cf5016aa-86c7-58c7-8caf-d40f68706b18, identifier: RE87143
2026-03-30 09:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cf5016aa-86c7-58c7-8caf-d40f68706b18 with identifier: RE87143
2026-03-30 09:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cf5016aa-86c7-58c7-8caf-d40f68706b18 with identifier: RE87143
2026-03-30 09:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cf5016aa-86c7-58c7-8caf-d40f68706b18 with identifier: RE87143 to the API
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:41:12Z',
 'fuel_type': 'diesel',
 'id': 'cf5016aa-86c7-58c7-8caf-d40f68706b18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE87143',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 198723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTD Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2017}
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE87143%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Saving data for RE87143: {'auction_closing_time': 1774885272.0, 'created_time': 1774559164.361556, 'last_price_update_time': 1774861650.810327}
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RE87143') HTTP/1.1" 204 0
2026-03-30 09:07:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: PU90509
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU90509%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for PU90509: 0
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: TG60202
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: BJ73113
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ73113%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for BJ73113: 2
2026-03-30 09:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee88c64b-1a85-5396-8f91-c99b451cf916 with identifier: BJ73113
2026-03-30 09:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee88c64b-1a85-5396-8f91-c99b451cf916 with scrape type 2
2026-03-30 09:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee88c64b-1a85-5396-8f91-c99b451cf916 with scrape type 2
2026-03-30 09:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee88c64b-1a85-5396-8f91-c99b451cf916, identifier: BJ73113
2026-03-30 09:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee88c64b-1a85-5396-8f91-c99b451cf916 with identifier: BJ73113
2026-03-30 09:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee88c64b-1a85-5396-8f91-c99b451cf916 with identifier: BJ73113
2026-03-30 09:07:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ee88c64b-1a85-5396-8f91-c99b451cf916 with identifier: BJ73113 to the API
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:55:50Z',
 'fuel_type': 'petrol',
 'id': 'ee88c64b-1a85-5396-8f91-c99b451cf916',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ73113',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 12272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-28',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2023}
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ73113%27 HTTP/1.1" 200 None
2026-03-30 09:07:31 [auto1.it] INFO: Saving data for BJ73113: {'auction_closing_time': 1774886150.0, 'created_time': 1774559123.616649, 'last_price_update_time': 1774861651.856919}
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ73113') HTTP/1.1" 204 0
2026-03-30 09:07:31 [auto1.it] INFO: Found listing with ID: TX50484
2026-03-30 09:07:31 [auto1.it] INFO: Found listing with ID: JU23021
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU23021%27 HTTP/1.1" 200 None
2026-03-30 09:07:31 [auto1.it] INFO: Scrape type for JU23021: 0
2026-03-30 09:07:31 [auto1.it] INFO: Found listing with ID: DE48831
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE48831%27 HTTP/1.1" 200 None
2026-03-30 09:07:31 [auto1.it] INFO: Scrape type for DE48831: 0
2026-03-30 09:07:31 [auto1.it] INFO: Found listing with ID: PG69305
2026-03-30 09:07:31 [auto1.it] INFO: Found listing with ID: JS62412
2026-03-30 09:07:31 [auto1.it] INFO: Found listing with ID: RW64625
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW64625%27 HTTP/1.1" 200 None
2026-03-30 09:07:31 [auto1.it] INFO: Scrape type for RW64625: 0
2026-03-30 09:07:31 [auto1.it] INFO: Found listing with ID: WX67440
2026-03-30 09:07:31 [auto1.it] INFO: Found listing with ID: ZR26877
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR26877%27 HTTP/1.1" 200 None
2026-03-30 09:07:31 [auto1.it] INFO: Scrape type for ZR26877: 0
2026-03-30 09:07:31 [auto1.it] INFO: Found listing with ID: SE55523
2026-03-30 09:07:31 [auto1.it] INFO: Found listing with ID: YF34065
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF34065%27 HTTP/1.1" 200 None
2026-03-30 09:07:32 [auto1.it] INFO: Scrape type for YF34065: 0
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: CV31826
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: MN82158
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN82158%27 HTTP/1.1" 200 None
2026-03-30 09:07:32 [auto1.it] INFO: Scrape type for MN82158: 0
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: TK22539
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK22539%27 HTTP/1.1" 200 None
2026-03-30 09:07:32 [auto1.it] INFO: Scrape type for TK22539: 0
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: NW47878
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: XY34648
2026-03-30 09:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:32 [auto1.it] INFO: Channel: 24h | Page: 39 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: NJ83998
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ83998%27 HTTP/1.1" 200 None
2026-03-30 09:07:32 [auto1.it] INFO: Scrape type for NJ83998: 0
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: TZ83635
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83635%27 HTTP/1.1" 200 None
2026-03-30 09:07:32 [auto1.it] INFO: Scrape type for TZ83635: 0
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: WH83035
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH83035%27 HTTP/1.1" 200 None
2026-03-30 09:07:32 [auto1.it] INFO: Scrape type for WH83035: 0
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: XJ39556
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ39556%27 HTTP/1.1" 200 None
2026-03-30 09:07:32 [auto1.it] INFO: Scrape type for XJ39556: 0
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: PG99334
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG99334%27 HTTP/1.1" 200 None
2026-03-30 09:07:32 [auto1.it] INFO: Scrape type for PG99334: 0
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: BC39052
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC39052%27 HTTP/1.1" 200 None
2026-03-30 09:07:32 [auto1.it] INFO: Scrape type for BC39052: 2
2026-03-30 09:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97dd6d46-a214-5d63-bc6d-f125388f93f5 with identifier: BC39052
2026-03-30 09:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97dd6d46-a214-5d63-bc6d-f125388f93f5 with scrape type 2
2026-03-30 09:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97dd6d46-a214-5d63-bc6d-f125388f93f5 with scrape type 2
2026-03-30 09:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97dd6d46-a214-5d63-bc6d-f125388f93f5, identifier: BC39052
2026-03-30 09:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97dd6d46-a214-5d63-bc6d-f125388f93f5 with identifier: BC39052
2026-03-30 09:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97dd6d46-a214-5d63-bc6d-f125388f93f5 with identifier: BC39052
2026-03-30 09:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97dd6d46-a214-5d63-bc6d-f125388f93f5 with identifier: BC39052 to the API
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:24:21Z',
 'fuel_type': 'diesel',
 'id': '97dd6d46-a214-5d63-bc6d-f125388f93f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC39052',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 95819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-04',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC39052%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [auto1.it] INFO: Saving data for BC39052: {'auction_closing_time': 1774884261.0, 'created_time': 1774559181.902271, 'last_price_update_time': 1774861653.293044}
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BC39052') HTTP/1.1" 204 0
2026-03-30 09:07:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: HS01763
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: HY24657
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY24657%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [auto1.it] INFO: Scrape type for HY24657: 2
2026-03-30 09:07:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b07a29bc-80fd-5b09-97c2-70d8abcd77e6 with identifier: HY24657
2026-03-30 09:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b07a29bc-80fd-5b09-97c2-70d8abcd77e6 with scrape type 2
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b07a29bc-80fd-5b09-97c2-70d8abcd77e6 with scrape type 2
2026-03-30 09:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b07a29bc-80fd-5b09-97c2-70d8abcd77e6, identifier: HY24657
2026-03-30 09:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b07a29bc-80fd-5b09-97c2-70d8abcd77e6 with identifier: HY24657
2026-03-30 09:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b07a29bc-80fd-5b09-97c2-70d8abcd77e6 with identifier: HY24657
2026-03-30 09:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b07a29bc-80fd-5b09-97c2-70d8abcd77e6 with identifier: HY24657 to the API
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:11:47Z',
 'fuel_type': 'diesel',
 'id': 'b07a29bc-80fd-5b09-97c2-70d8abcd77e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY24657',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 220951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-12',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2015}
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY24657%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [auto1.it] INFO: Saving data for HY24657: {'auction_closing_time': 1774883507.0, 'created_time': 1774559074.880682, 'last_price_update_time': 1774861653.830858}
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY24657') HTTP/1.1" 204 0
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: TL14575
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL14575%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [auto1.it] INFO: Scrape type for TL14575: 0
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: KB32662
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: RC58822
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC58822%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [auto1.it] INFO: Scrape type for RC58822: 0
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: GX95672
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: FT43083
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: KW54926
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW54926%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [auto1.it] INFO: Scrape type for KW54926: 0
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: GD67829
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: NC97185
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC97185%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [auto1.it] INFO: Scrape type for NC97185: 0
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: MH53431
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: CW25523
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW25523%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [auto1.it] INFO: Scrape type for CW25523: 0
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: XR70694
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR70694%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [auto1.it] INFO: Scrape type for XR70694: 2
2026-03-30 09:07:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaf9ee38-bb80-5c79-bb3f-4e7ff38b428b with identifier: XR70694
2026-03-30 09:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaf9ee38-bb80-5c79-bb3f-4e7ff38b428b with scrape type 2
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaf9ee38-bb80-5c79-bb3f-4e7ff38b428b with scrape type 2
2026-03-30 09:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aaf9ee38-bb80-5c79-bb3f-4e7ff38b428b, identifier: XR70694
2026-03-30 09:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aaf9ee38-bb80-5c79-bb3f-4e7ff38b428b with identifier: XR70694
2026-03-30 09:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aaf9ee38-bb80-5c79-bb3f-4e7ff38b428b with identifier: XR70694
2026-03-30 09:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aaf9ee38-bb80-5c79-bb3f-4e7ff38b428b with identifier: XR70694 to the API
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:06:05Z',
 'fuel_type': 'diesel',
 'id': 'aaf9ee38-bb80-5c79-bb3f-4e7ff38b428b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR70694',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 145594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-16',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Business FWD',
 'transmission': 'automatic',
 'trim': 'Business FWD',
 'year': 2017}
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR70694%27 HTTP/1.1" 200 None
2026-03-30 09:07:34 [auto1.it] INFO: Saving data for XR70694: {'auction_closing_time': 1774883165.0, 'created_time': 1773130286.190537, 'last_price_update_time': 1774861654.3906}
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XR70694') HTTP/1.1" 204 0
2026-03-30 09:07:34 [auto1.it] INFO: Found listing with ID: MS98879
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS98879%27 HTTP/1.1" 200 None
2026-03-30 09:07:34 [auto1.it] INFO: Scrape type for MS98879: 0
2026-03-30 09:07:34 [auto1.it] INFO: Found listing with ID: XM00417
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM00417%27 HTTP/1.1" 200 None
2026-03-30 09:07:34 [auto1.it] INFO: Scrape type for XM00417: 2
2026-03-30 09:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f5baf21-3991-5da7-8088-75a34938c13e with identifier: XM00417
2026-03-30 09:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f5baf21-3991-5da7-8088-75a34938c13e with scrape type 2
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f5baf21-3991-5da7-8088-75a34938c13e with scrape type 2
2026-03-30 09:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f5baf21-3991-5da7-8088-75a34938c13e, identifier: XM00417
2026-03-30 09:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f5baf21-3991-5da7-8088-75a34938c13e with identifier: XM00417
2026-03-30 09:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f5baf21-3991-5da7-8088-75a34938c13e with identifier: XM00417
2026-03-30 09:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f5baf21-3991-5da7-8088-75a34938c13e with identifier: XM00417 to the API
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:03:02Z',
 'fuel_type': 'diesel',
 'id': '9f5baf21-3991-5da7-8088-75a34938c13e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM00417',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Freelander',
 'odometer': 209740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-15',
 'seller_name': None,
 'title': 'Land Rover Freelander 2.2 Td4 SD4 SE',
 'transmission': 'automatic',
 'trim': 'SD4 SE',
 'year': 2013}
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM00417%27 HTTP/1.1" 200 None
2026-03-30 09:07:34 [auto1.it] INFO: Saving data for XM00417: {'auction_closing_time': 1774882982.0, 'created_time': 1774645697.802212, 'last_price_update_time': 1774861654.994532}
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XM00417') HTTP/1.1" 204 0
2026-03-30 09:07:35 [auto1.it] INFO: Found listing with ID: GW90153
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW90153%27 HTTP/1.1" 200 None
2026-03-30 09:07:35 [auto1.it] INFO: Scrape type for GW90153: 0
2026-03-30 09:07:35 [auto1.it] INFO: Found listing with ID: HZ95408
2026-03-30 09:07:35 [auto1.it] INFO: Found listing with ID: EK65593
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK65593%27 HTTP/1.1" 200 None
2026-03-30 09:07:35 [auto1.it] INFO: Scrape type for EK65593: 2
2026-03-30 09:07:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f0a25de-4c18-589f-9e9a-fe911b50dd0c with identifier: EK65593
2026-03-30 09:07:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f0a25de-4c18-589f-9e9a-fe911b50dd0c with scrape type 2
2026-03-30 09:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f0a25de-4c18-589f-9e9a-fe911b50dd0c with scrape type 2
2026-03-30 09:07:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f0a25de-4c18-589f-9e9a-fe911b50dd0c, identifier: EK65593
2026-03-30 09:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f0a25de-4c18-589f-9e9a-fe911b50dd0c with identifier: EK65593
2026-03-30 09:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f0a25de-4c18-589f-9e9a-fe911b50dd0c with identifier: EK65593
2026-03-30 09:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f0a25de-4c18-589f-9e9a-fe911b50dd0c with identifier: EK65593 to the API
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-30T15:39:13Z',
 'fuel_type': 'diesel',
 'id': '0f0a25de-4c18-589f-9e9a-fe911b50dd0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK65593',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC70',
 'odometer': 248146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-18',
 'seller_name': None,
 'title': 'Volvo XC70 2.4 D5 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2013}
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK65593%27 HTTP/1.1" 200 None
2026-03-30 09:07:35 [auto1.it] INFO: Saving data for EK65593: {'auction_closing_time': 1774885153.0, 'created_time': 1774558875.133243, 'last_price_update_time': 1774861655.440826}
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EK65593') HTTP/1.1" 204 0
2026-03-30 09:07:35 [auto1.it] INFO: Found listing with ID: TT44801
2026-03-30 09:07:35 [auto1.it] INFO: Found listing with ID: ZV86353
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV86353%27 HTTP/1.1" 200 None
2026-03-30 09:07:35 [auto1.it] INFO: Scrape type for ZV86353: 2
2026-03-30 09:07:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83d7b17b-bd9d-59d5-bfd6-8434e1e8e1b9 with identifier: ZV86353
2026-03-30 09:07:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83d7b17b-bd9d-59d5-bfd6-8434e1e8e1b9 with scrape type 2
2026-03-30 09:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83d7b17b-bd9d-59d5-bfd6-8434e1e8e1b9 with scrape type 2
2026-03-30 09:07:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 83d7b17b-bd9d-59d5-bfd6-8434e1e8e1b9, identifier: ZV86353
2026-03-30 09:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 83d7b17b-bd9d-59d5-bfd6-8434e1e8e1b9 with identifier: ZV86353
2026-03-30 09:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 83d7b17b-bd9d-59d5-bfd6-8434e1e8e1b9 with identifier: ZV86353
2026-03-30 09:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 83d7b17b-bd9d-59d5-bfd6-8434e1e8e1b9 with identifier: ZV86353 to the API
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:11:24Z',
 'fuel_type': 'petrol',
 'id': '83d7b17b-bd9d-59d5-bfd6-8434e1e8e1b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV86353',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 148815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-11-20',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2001}
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV86353%27 HTTP/1.1" 200 None
2026-03-30 09:07:35 [auto1.it] INFO: Saving data for ZV86353: {'auction_closing_time': 1774883484.0, 'created_time': 1774558970.476431, 'last_price_update_time': 1774861655.955774}
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZV86353') HTTP/1.1" 204 0
2026-03-30 09:07:36 [auto1.it] INFO: Found listing with ID: CU49337
2026-03-30 09:07:36 [auto1.it] INFO: Found listing with ID: AG84200
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG84200%27 HTTP/1.1" 200 None
2026-03-30 09:07:36 [auto1.it] INFO: Scrape type for AG84200: 2
2026-03-30 09:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74b08cec-99b9-5f30-9756-901ddcf8315f with identifier: AG84200
2026-03-30 09:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b08cec-99b9-5f30-9756-901ddcf8315f with scrape type 2
2026-03-30 09:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74b08cec-99b9-5f30-9756-901ddcf8315f with scrape type 2
2026-03-30 09:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 74b08cec-99b9-5f30-9756-901ddcf8315f, identifier: AG84200
2026-03-30 09:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 74b08cec-99b9-5f30-9756-901ddcf8315f with identifier: AG84200
2026-03-30 09:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 74b08cec-99b9-5f30-9756-901ddcf8315f with identifier: AG84200
2026-03-30 09:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 74b08cec-99b9-5f30-9756-901ddcf8315f with identifier: AG84200 to the API
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:20:40Z',
 'fuel_type': 'diesel',
 'id': '74b08cec-99b9-5f30-9756-901ddcf8315f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG84200',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 236291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-16',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC sport',
 'transmission': 'automatic',
 'trim': 'BlueTEC sport',
 'year': 2015}
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG84200%27 HTTP/1.1" 200 None
2026-03-30 09:07:36 [auto1.it] INFO: Saving data for AG84200: {'auction_closing_time': 1774884040.0, 'created_time': 1774645722.601625, 'last_price_update_time': 1774861656.557614}
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AG84200') HTTP/1.1" 204 0
2026-03-30 09:07:36 [auto1.it] INFO: Found listing with ID: YX87347
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX87347%27 HTTP/1.1" 200 None
2026-03-30 09:07:36 [auto1.it] INFO: Scrape type for YX87347: 0
2026-03-30 09:07:36 [auto1.it] INFO: Found listing with ID: UW94573
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW94573%27 HTTP/1.1" 200 None
2026-03-30 09:07:36 [auto1.it] INFO: Scrape type for UW94573: 2
2026-03-30 09:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6cac266-381f-5051-b034-51b7b13fa125 with identifier: UW94573
2026-03-30 09:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6cac266-381f-5051-b034-51b7b13fa125 with scrape type 2
2026-03-30 09:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6cac266-381f-5051-b034-51b7b13fa125 with scrape type 2
2026-03-30 09:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6cac266-381f-5051-b034-51b7b13fa125, identifier: UW94573
2026-03-30 09:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6cac266-381f-5051-b034-51b7b13fa125 with identifier: UW94573
2026-03-30 09:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6cac266-381f-5051-b034-51b7b13fa125 with identifier: UW94573
2026-03-30 09:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6cac266-381f-5051-b034-51b7b13fa125 with identifier: UW94573 to the API
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:06Z',
 'fuel_type': 'diesel',
 'id': 'a6cac266-381f-5051-b034-51b7b13fa125',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW94573',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 220893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-31',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.2 D-4D Crossover Luxury',
 'transmission': 'automatic',
 'trim': 'Crossover Luxury',
 'year': 2009}
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW94573%27 HTTP/1.1" 200 None
2026-03-30 09:07:37 [auto1.it] INFO: Saving data for UW94573: {'auction_closing_time': 1774884666.0, 'created_time': 1773403779.734526, 'last_price_update_time': 1774861657.039882}
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UW94573') HTTP/1.1" 204 0
2026-03-30 09:07:37 [auto1.it] INFO: Found listing with ID: WN29902
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN29902%27 HTTP/1.1" 200 None
2026-03-30 09:07:37 [auto1.it] INFO: Scrape type for WN29902: 2
2026-03-30 09:07:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d71a7734-15f9-57bb-8674-67e54a6ec876 with identifier: WN29902
2026-03-30 09:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d71a7734-15f9-57bb-8674-67e54a6ec876 with scrape type 2
2026-03-30 09:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d71a7734-15f9-57bb-8674-67e54a6ec876 with scrape type 2
2026-03-30 09:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d71a7734-15f9-57bb-8674-67e54a6ec876, identifier: WN29902
2026-03-30 09:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d71a7734-15f9-57bb-8674-67e54a6ec876 with identifier: WN29902
2026-03-30 09:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d71a7734-15f9-57bb-8674-67e54a6ec876 with identifier: WN29902
2026-03-30 09:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d71a7734-15f9-57bb-8674-67e54a6ec876 with identifier: WN29902 to the API
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:48:32Z',
 'fuel_type': 'petrol',
 'id': 'd71a7734-15f9-57bb-8674-67e54a6ec876',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN29902',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Avenger',
 'odometer': 33995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-04-29',
 'seller_name': None,
 'title': 'Jeep Avenger 1.2 T-GDI Altitude',
 'transmission': 'manual',
 'trim': 'Altitude',
 'year': 2025}
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN29902%27 HTTP/1.1" 200 None
2026-03-30 09:07:37 [auto1.it] INFO: Saving data for WN29902: {'auction_closing_time': 1774885712.0, 'created_time': 1773435678.159746, 'last_price_update_time': 1774861657.583397}
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WN29902') HTTP/1.1" 204 0
2026-03-30 09:07:37 [auto1.it] INFO: Found listing with ID: GA39078
2026-03-30 09:07:37 [auto1.it] INFO: Found listing with ID: HF24893
2026-03-30 09:07:37 [auto1.it] INFO: Found listing with ID: KZ16799
2026-03-30 09:07:37 [auto1.it] INFO: Found listing with ID: SR16589
2026-03-30 09:07:37 [auto1.it] INFO: Found listing with ID: NL55256
2026-03-30 09:07:37 [auto1.it] INFO: Found listing with ID: VN35608
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN35608%27 HTTP/1.1" 200 None
2026-03-30 09:07:37 [auto1.it] INFO: Scrape type for VN35608: 0
2026-03-30 09:07:37 [auto1.it] INFO: Found listing with ID: FZ10631
2026-03-30 09:07:37 [auto1.it] INFO: Found listing with ID: YT67370
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT67370%27 HTTP/1.1" 200 None
2026-03-30 09:07:37 [auto1.it] INFO: Scrape type for YT67370: 0
2026-03-30 09:07:37 [auto1.it] INFO: Found listing with ID: LC36038
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC36038%27 HTTP/1.1" 200 None
2026-03-30 09:07:37 [auto1.it] INFO: Scrape type for LC36038: 0
2026-03-30 09:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:39 [auto1.it] INFO: Channel: 24h | Page: 40 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:39 [auto1.it] INFO: Found listing with ID: UF75242
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF75242%27 HTTP/1.1" 200 None
2026-03-30 09:07:39 [auto1.it] INFO: Scrape type for UF75242: 0
2026-03-30 09:07:39 [auto1.it] INFO: Found listing with ID: EC29909
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC29909%27 HTTP/1.1" 200 None
2026-03-30 09:07:39 [auto1.it] INFO: Scrape type for EC29909: 0
2026-03-30 09:07:39 [auto1.it] INFO: Found listing with ID: PE07911
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE07911%27 HTTP/1.1" 200 None
2026-03-30 09:07:39 [auto1.it] INFO: Scrape type for PE07911: 0
2026-03-30 09:07:39 [auto1.it] INFO: Found listing with ID: XD70855
2026-03-30 09:07:39 [auto1.it] INFO: Found listing with ID: JW87652
2026-03-30 09:07:39 [auto1.it] INFO: Found listing with ID: RF52556
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF52556%27 HTTP/1.1" 200 None
2026-03-30 09:07:39 [auto1.it] INFO: Scrape type for RF52556: 2
2026-03-30 09:07:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3255b7fb-898b-5a40-a1b9-63c214f3e427 with identifier: RF52556
2026-03-30 09:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3255b7fb-898b-5a40-a1b9-63c214f3e427 with scrape type 2
2026-03-30 09:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3255b7fb-898b-5a40-a1b9-63c214f3e427 with scrape type 2
2026-03-30 09:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3255b7fb-898b-5a40-a1b9-63c214f3e427, identifier: RF52556
2026-03-30 09:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3255b7fb-898b-5a40-a1b9-63c214f3e427 with identifier: RF52556
2026-03-30 09:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3255b7fb-898b-5a40-a1b9-63c214f3e427 with identifier: RF52556
2026-03-30 09:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3255b7fb-898b-5a40-a1b9-63c214f3e427 with identifier: RF52556 to the API
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:14:50Z',
 'fuel_type': 'diesel',
 'id': '3255b7fb-898b-5a40-a1b9-63c214f3e427',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF52556',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 282155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-20',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF52556%27 HTTP/1.1" 200 None
2026-03-30 09:07:39 [auto1.it] INFO: Saving data for RF52556: {'auction_closing_time': 1774883690.0, 'created_time': 1774559079.506529, 'last_price_update_time': 1774861659.912714}
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF52556') HTTP/1.1" 204 0
2026-03-30 09:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: NC90447
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC90447%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [auto1.it] INFO: Scrape type for NC90447: 0
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: KC88615
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC88615%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [auto1.it] INFO: Scrape type for KC88615: 0
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: GC55004
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC55004%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [auto1.it] INFO: Scrape type for GC55004: 0
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: TV99764
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: ZG57893
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG57893%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [auto1.it] INFO: Scrape type for ZG57893: 0
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: YG18020
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: WH55866
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: FD29696
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD29696%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [auto1.it] INFO: Scrape type for FD29696: 0
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: HD54235
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: GT76958
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: NH73732
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: EZ12960
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ12960%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [auto1.it] INFO: Scrape type for EZ12960: 2
2026-03-30 09:07:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1736290b-710c-5edd-96e9-a0924328d5d7 with identifier: EZ12960
2026-03-30 09:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1736290b-710c-5edd-96e9-a0924328d5d7 with scrape type 2
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1736290b-710c-5edd-96e9-a0924328d5d7 with scrape type 2
2026-03-30 09:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1736290b-710c-5edd-96e9-a0924328d5d7, identifier: EZ12960
2026-03-30 09:07:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1736290b-710c-5edd-96e9-a0924328d5d7 with identifier: EZ12960
2026-03-30 09:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1736290b-710c-5edd-96e9-a0924328d5d7 with identifier: EZ12960
2026-03-30 09:07:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1736290b-710c-5edd-96e9-a0924328d5d7 with identifier: EZ12960 to the API
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:22:16Z',
 'fuel_type': 'diesel',
 'id': '1736290b-710c-5edd-96e9-a0924328d5d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ12960',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7',
 'odometer': 52415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-28',
 'seller_name': None,
 'title': 'DS Automobiles DS7 1.5 Blue-HDi Rivoli',
 'transmission': 'automatic',
 'trim': 'Rivoli',
 'year': 2022}
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ12960%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [auto1.it] INFO: Saving data for EZ12960: {'auction_closing_time': 1774884136.0, 'created_time': 1774645670.984214, 'last_price_update_time': 1774861660.574595}
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ12960') HTTP/1.1" 204 0
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: EZ73351
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ73351%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [auto1.it] INFO: Scrape type for EZ73351: 0
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: PM88021
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM88021%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [auto1.it] INFO: Scrape type for PM88021: 0
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: GT16338
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: WZ40427
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ40427%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [auto1.it] INFO: Scrape type for WZ40427: 2
2026-03-30 09:07:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c60290e3-01ba-5492-8a54-096bcf910888 with identifier: WZ40427
2026-03-30 09:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c60290e3-01ba-5492-8a54-096bcf910888 with scrape type 2
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c60290e3-01ba-5492-8a54-096bcf910888 with scrape type 2
2026-03-30 09:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c60290e3-01ba-5492-8a54-096bcf910888, identifier: WZ40427
2026-03-30 09:07:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c60290e3-01ba-5492-8a54-096bcf910888 with identifier: WZ40427
2026-03-30 09:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c60290e3-01ba-5492-8a54-096bcf910888 with identifier: WZ40427
2026-03-30 09:07:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c60290e3-01ba-5492-8a54-096bcf910888 with identifier: WZ40427 to the API
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:07:57Z',
 'fuel_type': 'diesel',
 'id': 'c60290e3-01ba-5492-8a54-096bcf910888',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ40427',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 127069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Tech & Sound BlueMotion',
 'transmission': 'manual',
 'trim': 'Tech & Sound BlueMotion',
 'year': 2014}
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ40427%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [auto1.it] INFO: Saving data for WZ40427: {'auction_closing_time': 1774883277.0, 'created_time': 1774558879.794538, 'last_price_update_time': 1774861661.314894}
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WZ40427') HTTP/1.1" 204 0
2026-03-30 09:07:41 [auto1.it] INFO: Found listing with ID: WV44347
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV44347%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [auto1.it] INFO: Scrape type for WV44347: 2
2026-03-30 09:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd1c81f5-168e-5594-b3c2-9661fd6e3cc3 with identifier: WV44347
2026-03-30 09:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd1c81f5-168e-5594-b3c2-9661fd6e3cc3 with scrape type 2
2026-03-30 09:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd1c81f5-168e-5594-b3c2-9661fd6e3cc3 with scrape type 2
2026-03-30 09:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd1c81f5-168e-5594-b3c2-9661fd6e3cc3, identifier: WV44347
2026-03-30 09:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd1c81f5-168e-5594-b3c2-9661fd6e3cc3 with identifier: WV44347
2026-03-30 09:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd1c81f5-168e-5594-b3c2-9661fd6e3cc3 with identifier: WV44347
2026-03-30 09:07:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd1c81f5-168e-5594-b3c2-9661fd6e3cc3 with identifier: WV44347 to the API
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:02:03Z',
 'fuel_type': 'petrol',
 'id': 'cd1c81f5-168e-5594-b3c2-9661fd6e3cc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV44347',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 172379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Executive BlueMotion',
 'transmission': 'automatic',
 'trim': 'Executive BlueMotion',
 'year': 2018}
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV44347%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [auto1.it] INFO: Saving data for WV44347: {'auction_closing_time': 1774882923.0, 'created_time': 1774645653.054804, 'last_price_update_time': 1774861661.735852}
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WV44347') HTTP/1.1" 204 0
2026-03-30 09:07:41 [auto1.it] INFO: Found listing with ID: FH81414
2026-03-30 09:07:41 [auto1.it] INFO: Found listing with ID: NM56587
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM56587%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [auto1.it] INFO: Scrape type for NM56587: 0
2026-03-30 09:07:41 [auto1.it] INFO: Found listing with ID: AP78180
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP78180%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [auto1.it] INFO: Scrape type for AP78180: 0
2026-03-30 09:07:41 [auto1.it] INFO: Found listing with ID: RC69852
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC69852%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [auto1.it] INFO: Scrape type for RC69852: 2
2026-03-30 09:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f26ae2a2-8904-55ad-9137-2a9832cc01a1 with identifier: RC69852
2026-03-30 09:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26ae2a2-8904-55ad-9137-2a9832cc01a1 with scrape type 2
2026-03-30 09:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f26ae2a2-8904-55ad-9137-2a9832cc01a1 with scrape type 2
2026-03-30 09:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f26ae2a2-8904-55ad-9137-2a9832cc01a1, identifier: RC69852
2026-03-30 09:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f26ae2a2-8904-55ad-9137-2a9832cc01a1 with identifier: RC69852
2026-03-30 09:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f26ae2a2-8904-55ad-9137-2a9832cc01a1 with identifier: RC69852
2026-03-30 09:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f26ae2a2-8904-55ad-9137-2a9832cc01a1 with identifier: RC69852 to the API
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:23:59Z',
 'fuel_type': 'diesel',
 'id': 'f26ae2a2-8904-55ad-9137-2a9832cc01a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC69852',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 110045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-04',
 'seller_name': None,
 'title': 'Audi A1 1.4 TDI Metal',
 'transmission': 'manual',
 'trim': 'Metal',
 'year': 2015}
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC69852%27 HTTP/1.1" 200 None
2026-03-30 09:07:42 [auto1.it] INFO: Saving data for RC69852: {'auction_closing_time': 1774884239.0, 'created_time': 1773130017.664197, 'last_price_update_time': 1774861662.194256}
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RC69852') HTTP/1.1" 204 0
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: XB17509
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB17509%27 HTTP/1.1" 200 None
2026-03-30 09:07:42 [auto1.it] INFO: Scrape type for XB17509: 0
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: DW69714
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW69714%27 HTTP/1.1" 200 None
2026-03-30 09:07:42 [auto1.it] INFO: Scrape type for DW69714: 0
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: DS58810
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: JC86695
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC86695%27 HTTP/1.1" 200 None
2026-03-30 09:07:42 [auto1.it] INFO: Scrape type for JC86695: 0
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: SE79185
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: HN90303
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: GT17675
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: JT48153
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: PD12623
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: KT77401
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT77401%27 HTTP/1.1" 200 None
2026-03-30 09:07:42 [auto1.it] INFO: Scrape type for KT77401: 2
2026-03-30 09:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d235dea-8e83-57cd-8278-cebc9c75ae6f with identifier: KT77401
2026-03-30 09:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d235dea-8e83-57cd-8278-cebc9c75ae6f with scrape type 2
2026-03-30 09:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d235dea-8e83-57cd-8278-cebc9c75ae6f with scrape type 2
2026-03-30 09:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d235dea-8e83-57cd-8278-cebc9c75ae6f, identifier: KT77401
2026-03-30 09:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d235dea-8e83-57cd-8278-cebc9c75ae6f with identifier: KT77401
2026-03-30 09:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d235dea-8e83-57cd-8278-cebc9c75ae6f with identifier: KT77401
2026-03-30 09:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d235dea-8e83-57cd-8278-cebc9c75ae6f with identifier: KT77401 to the API
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:14:29Z',
 'fuel_type': 'diesel',
 'id': '9d235dea-8e83-57cd-8278-cebc9c75ae6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT77401',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 135153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Executive BlueMotion',
 'transmission': 'automatic',
 'trim': 'Executive BlueMotion',
 'year': 2018}
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT77401%27 HTTP/1.1" 200 None
2026-03-30 09:07:42 [auto1.it] INFO: Saving data for KT77401: {'auction_closing_time': 1774883669.0, 'created_time': 1774645643.729469, 'last_price_update_time': 1774861662.704817}
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT77401') HTTP/1.1" 204 0
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: UC06691
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC06691%27 HTTP/1.1" 200 None
2026-03-30 09:07:42 [auto1.it] INFO: Scrape type for UC06691: 2
2026-03-30 09:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1ca3726-ee9f-533d-96d2-ca1f916ed984 with identifier: UC06691
2026-03-30 09:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1ca3726-ee9f-533d-96d2-ca1f916ed984 with scrape type 2
2026-03-30 09:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1ca3726-ee9f-533d-96d2-ca1f916ed984 with scrape type 2
2026-03-30 09:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b1ca3726-ee9f-533d-96d2-ca1f916ed984, identifier: UC06691
2026-03-30 09:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b1ca3726-ee9f-533d-96d2-ca1f916ed984 with identifier: UC06691
2026-03-30 09:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b1ca3726-ee9f-533d-96d2-ca1f916ed984 with identifier: UC06691
2026-03-30 09:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b1ca3726-ee9f-533d-96d2-ca1f916ed984 with identifier: UC06691 to the API
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:28:11Z',
 'fuel_type': 'diesel',
 'id': 'b1ca3726-ee9f-533d-96d2-ca1f916ed984',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC06691',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 81063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-02',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2018}
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC06691%27 HTTP/1.1" 200 None
2026-03-30 09:07:43 [auto1.it] INFO: Saving data for UC06691: {'auction_closing_time': 1774884491.0, 'created_time': 1774083633.750991, 'last_price_update_time': 1774861663.241041}
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UC06691') HTTP/1.1" 204 0
2026-03-30 09:07:43 [auto1.it] INFO: Found listing with ID: ED34625
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED34625%27 HTTP/1.1" 200 None
2026-03-30 09:07:43 [auto1.it] INFO: Scrape type for ED34625: 0
2026-03-30 09:07:43 [auto1.it] INFO: Found listing with ID: JN59652
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN59652%27 HTTP/1.1" 200 None
2026-03-30 09:07:43 [auto1.it] INFO: Scrape type for JN59652: 0
2026-03-30 09:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:47 [auto1.it] INFO: Channel: 24h | Page: 41 | totalHits: 3305 | hits on page: 40
2026-03-30 09:07:47 [auto1.it] INFO: Found listing with ID: JN59652
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN59652%27 HTTP/1.1" 200 None
2026-03-30 09:07:47 [auto1.it] INFO: Scrape type for JN59652: 0
2026-03-30 09:07:47 [auto1.it] INFO: Found listing with ID: FZ12921
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ12921%27 HTTP/1.1" 200 None
2026-03-30 09:07:47 [auto1.it] INFO: Scrape type for FZ12921: 0
2026-03-30 09:07:47 [auto1.it] INFO: Found listing with ID: JB83291
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB83291%27 HTTP/1.1" 200 None
2026-03-30 09:07:47 [auto1.it] INFO: Scrape type for JB83291: 0
2026-03-30 09:07:47 [auto1.it] INFO: Found listing with ID: TL40655
2026-03-30 09:07:47 [auto1.it] INFO: Found listing with ID: LG12773
2026-03-30 09:07:47 [auto1.it] INFO: Found listing with ID: ST64226
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST64226%27 HTTP/1.1" 200 None
2026-03-30 09:07:47 [auto1.it] INFO: Scrape type for ST64226: 2
2026-03-30 09:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52fe7615-292c-5081-be42-e9ce3dd943a4 with identifier: ST64226
2026-03-30 09:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52fe7615-292c-5081-be42-e9ce3dd943a4 with scrape type 2
2026-03-30 09:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52fe7615-292c-5081-be42-e9ce3dd943a4 with scrape type 2
2026-03-30 09:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 52fe7615-292c-5081-be42-e9ce3dd943a4, identifier: ST64226
2026-03-30 09:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 52fe7615-292c-5081-be42-e9ce3dd943a4 with identifier: ST64226
2026-03-30 09:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 52fe7615-292c-5081-be42-e9ce3dd943a4 with identifier: ST64226
2026-03-30 09:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 52fe7615-292c-5081-be42-e9ce3dd943a4 with identifier: ST64226 to the API
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:10:59Z',
 'fuel_type': 'diesel',
 'id': '52fe7615-292c-5081-be42-e9ce3dd943a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST64226',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 149921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-22',
 'seller_name': None,
 'title': 'Opel Corsa 1.5 CDTI GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2020}
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST64226%27 HTTP/1.1" 200 None
2026-03-30 09:07:47 [auto1.it] INFO: Saving data for ST64226: {'auction_closing_time': 1774883459.0, 'created_time': 1773304990.520048, 'last_price_update_time': 1774861667.803537}
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ST64226') HTTP/1.1" 204 0
2026-03-30 09:07:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:47 [auto1.it] INFO: Found listing with ID: KZ84746
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ84746%27 HTTP/1.1" 200 None
2026-03-30 09:07:47 [auto1.it] INFO: Scrape type for KZ84746: 2
2026-03-30 09:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 836c01b8-d4d3-5bdf-ae29-054d289c479d with identifier: KZ84746
2026-03-30 09:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 836c01b8-d4d3-5bdf-ae29-054d289c479d with scrape type 2
2026-03-30 09:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 836c01b8-d4d3-5bdf-ae29-054d289c479d with scrape type 2
2026-03-30 09:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 836c01b8-d4d3-5bdf-ae29-054d289c479d, identifier: KZ84746
2026-03-30 09:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 836c01b8-d4d3-5bdf-ae29-054d289c479d with identifier: KZ84746
2026-03-30 09:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 836c01b8-d4d3-5bdf-ae29-054d289c479d with identifier: KZ84746
2026-03-30 09:07:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 836c01b8-d4d3-5bdf-ae29-054d289c479d with identifier: KZ84746 to the API
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:28:03Z',
 'fuel_type': 'diesel',
 'id': '836c01b8-d4d3-5bdf-ae29-054d289c479d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ84746',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 154414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ84746%27 HTTP/1.1" 200 None
2026-03-30 09:07:48 [auto1.it] INFO: Saving data for KZ84746: {'auction_closing_time': 1774884483.0, 'created_time': 1774558939.506976, 'last_price_update_time': 1774861668.356011}
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KZ84746') HTTP/1.1" 204 0
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: FT05147
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT05147%27 HTTP/1.1" 200 None
2026-03-30 09:07:48 [auto1.it] INFO: Scrape type for FT05147: 0
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: LE96160
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: SV71044
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: XL03216
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL03216%27 HTTP/1.1" 200 None
2026-03-30 09:07:48 [auto1.it] INFO: Scrape type for XL03216: 0
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: ZW92714
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW92714%27 HTTP/1.1" 200 None
2026-03-30 09:07:48 [auto1.it] INFO: Scrape type for ZW92714: 0
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: DR27432
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR27432%27 HTTP/1.1" 200 None
2026-03-30 09:07:48 [auto1.it] INFO: Scrape type for DR27432: 2
2026-03-30 09:07:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747725c9-068e-57d3-9b0f-ed0f9ea7eb1d with identifier: DR27432
2026-03-30 09:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747725c9-068e-57d3-9b0f-ed0f9ea7eb1d with scrape type 2
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 747725c9-068e-57d3-9b0f-ed0f9ea7eb1d with scrape type 2
2026-03-30 09:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 747725c9-068e-57d3-9b0f-ed0f9ea7eb1d, identifier: DR27432
2026-03-30 09:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 747725c9-068e-57d3-9b0f-ed0f9ea7eb1d with identifier: DR27432
2026-03-30 09:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 747725c9-068e-57d3-9b0f-ed0f9ea7eb1d with identifier: DR27432
2026-03-30 09:07:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 747725c9-068e-57d3-9b0f-ed0f9ea7eb1d with identifier: DR27432 to the API
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:18:12Z',
 'fuel_type': 'petrol',
 'id': '747725c9-068e-57d3-9b0f-ed0f9ea7eb1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR27432',
 'listing': 'auction',
 'make': 'Porsche',
 'model': '718 Cayman',
 'odometer': 42741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seller_name': None,
 'title': 'Porsche 718 Cayman 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR27432%27 HTTP/1.1" 200 None
2026-03-30 09:07:48 [auto1.it] INFO: Saving data for DR27432: {'auction_closing_time': 1774883892.0, 'created_time': 1774645680.871329, 'last_price_update_time': 1774861668.817108}
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DR27432') HTTP/1.1" 204 0
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: HS22715
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: GL53946
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: SC05419
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: TC64761
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC64761%27 HTTP/1.1" 200 None
2026-03-30 09:07:48 [auto1.it] INFO: Scrape type for TC64761: 0
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: XU52863
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU52863%27 HTTP/1.1" 200 None
2026-03-30 09:07:48 [auto1.it] INFO: Scrape type for XU52863: 2
2026-03-30 09:07:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d264189-7757-5d33-8dcb-f56ef9858e65 with identifier: XU52863
2026-03-30 09:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d264189-7757-5d33-8dcb-f56ef9858e65 with scrape type 2
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d264189-7757-5d33-8dcb-f56ef9858e65 with scrape type 2
2026-03-30 09:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d264189-7757-5d33-8dcb-f56ef9858e65, identifier: XU52863
2026-03-30 09:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d264189-7757-5d33-8dcb-f56ef9858e65 with identifier: XU52863
2026-03-30 09:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d264189-7757-5d33-8dcb-f56ef9858e65 with identifier: XU52863
2026-03-30 09:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d264189-7757-5d33-8dcb-f56ef9858e65 with identifier: XU52863 to the API
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:47:10Z',
 'fuel_type': 'diesel',
 'id': '0d264189-7757-5d33-8dcb-f56ef9858e65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU52863',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 203836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seller_name': None,
 'title': 'Maserati Levante 3.0 V6 Diesel GranLusso',
 'transmission': 'automatic',
 'trim': 'GranLusso',
 'year': 2018}
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU52863%27 HTTP/1.1" 200 None
2026-03-30 09:07:49 [auto1.it] INFO: Saving data for XU52863: {'auction_closing_time': 1774885630.0, 'created_time': 1774645395.911791, 'last_price_update_time': 1774861669.406122}
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XU52863') HTTP/1.1" 204 0
2026-03-30 09:07:49 [auto1.it] INFO: Found listing with ID: UC13059
2026-03-30 09:07:49 [auto1.it] INFO: Found listing with ID: WB86834
2026-03-30 09:07:49 [auto1.it] INFO: Found listing with ID: FF76752
2026-03-30 09:07:49 [auto1.it] INFO: Found listing with ID: WU65183
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU65183%27 HTTP/1.1" 200 None
2026-03-30 09:07:49 [auto1.it] INFO: Scrape type for WU65183: 2
2026-03-30 09:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 298a0621-b2f8-5f80-90a2-f01d5d0fb369 with identifier: WU65183
2026-03-30 09:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 298a0621-b2f8-5f80-90a2-f01d5d0fb369 with scrape type 2
2026-03-30 09:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 298a0621-b2f8-5f80-90a2-f01d5d0fb369 with scrape type 2
2026-03-30 09:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 298a0621-b2f8-5f80-90a2-f01d5d0fb369, identifier: WU65183
2026-03-30 09:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 298a0621-b2f8-5f80-90a2-f01d5d0fb369 with identifier: WU65183
2026-03-30 09:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 298a0621-b2f8-5f80-90a2-f01d5d0fb369 with identifier: WU65183
2026-03-30 09:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 298a0621-b2f8-5f80-90a2-f01d5d0fb369 with identifier: WU65183 to the API
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:40:26Z',
 'fuel_type': 'diesel',
 'id': '298a0621-b2f8-5f80-90a2-f01d5d0fb369',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU65183',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 228640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-27',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2016}
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU65183%27 HTTP/1.1" 200 None
2026-03-30 09:07:50 [auto1.it] INFO: Saving data for WU65183: {'auction_closing_time': 1774885226.0, 'created_time': 1774558919.519668, 'last_price_update_time': 1774861670.668315}
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WU65183') HTTP/1.1" 204 0
2026-03-30 09:07:50 [auto1.it] INFO: Found listing with ID: HK62879
2026-03-30 09:07:50 [auto1.it] INFO: Found listing with ID: PR79135
2026-03-30 09:07:50 [auto1.it] INFO: Found listing with ID: GX06628
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX06628%27 HTTP/1.1" 200 None
2026-03-30 09:07:50 [auto1.it] INFO: Scrape type for GX06628: 2
2026-03-30 09:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 758f809d-ed7f-5390-be0f-58503231a92b with identifier: GX06628
2026-03-30 09:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 758f809d-ed7f-5390-be0f-58503231a92b with scrape type 2
2026-03-30 09:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 758f809d-ed7f-5390-be0f-58503231a92b with scrape type 2
2026-03-30 09:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 758f809d-ed7f-5390-be0f-58503231a92b, identifier: GX06628
2026-03-30 09:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 758f809d-ed7f-5390-be0f-58503231a92b with identifier: GX06628
2026-03-30 09:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 758f809d-ed7f-5390-be0f-58503231a92b with identifier: GX06628
2026-03-30 09:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 758f809d-ed7f-5390-be0f-58503231a92b with identifier: GX06628 to the API
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:13:59Z',
 'fuel_type': 'diesel',
 'id': '758f809d-ed7f-5390-be0f-58503231a92b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX06628',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 227436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-30',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Veloce',
 'transmission': 'automatic',
 'trim': 'Veloce',
 'year': 2018}
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX06628%27 HTTP/1.1" 200 None
2026-03-30 09:07:52 [auto1.it] INFO: Saving data for GX06628: {'auction_closing_time': 1774883639.0, 'created_time': 1774645279.003468, 'last_price_update_time': 1774861672.144529}
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GX06628') HTTP/1.1" 204 0
2026-03-30 09:07:52 [auto1.it] INFO: Found listing with ID: BR31309
2026-03-30 09:07:52 [auto1.it] INFO: Found listing with ID: XW11641
2026-03-30 09:07:52 [auto1.it] INFO: Found listing with ID: LR54413
2026-03-30 09:07:52 [auto1.it] INFO: Found listing with ID: FF49180
2026-03-30 09:07:52 [auto1.it] INFO: Found listing with ID: CD07087
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD07087%27 HTTP/1.1" 200 None
2026-03-30 09:07:52 [auto1.it] INFO: Scrape type for CD07087: 0
2026-03-30 09:07:52 [auto1.it] INFO: Found listing with ID: TZ83708
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83708%27 HTTP/1.1" 200 None
2026-03-30 09:07:52 [auto1.it] INFO: Scrape type for TZ83708: 2
2026-03-30 09:07:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 915cec92-e071-5bf5-80cc-9bc514170474 with identifier: TZ83708
2026-03-30 09:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915cec92-e071-5bf5-80cc-9bc514170474 with scrape type 2
2026-03-30 09:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 915cec92-e071-5bf5-80cc-9bc514170474 with scrape type 2
2026-03-30 09:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 915cec92-e071-5bf5-80cc-9bc514170474, identifier: TZ83708
2026-03-30 09:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 915cec92-e071-5bf5-80cc-9bc514170474 with identifier: TZ83708
2026-03-30 09:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 915cec92-e071-5bf5-80cc-9bc514170474 with identifier: TZ83708
2026-03-30 09:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 915cec92-e071-5bf5-80cc-9bc514170474 with identifier: TZ83708 to the API
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:03:43Z',
 'fuel_type': 'diesel',
 'id': '915cec92-e071-5bf5-80cc-9bc514170474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ83708',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 133489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-28',
 'seller_name': None,
 'title': 'Fiat 500L 1.3 JTD Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2015}
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83708%27 HTTP/1.1" 200 None
2026-03-30 09:07:52 [auto1.it] INFO: Saving data for TZ83708: {'auction_closing_time': 1774883023.0, 'created_time': 1774558893.039404, 'last_price_update_time': 1774861672.87665}
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TZ83708') HTTP/1.1" 204 0
2026-03-30 09:07:52 [auto1.it] INFO: Found listing with ID: UE17288
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE17288%27 HTTP/1.1" 200 None
2026-03-30 09:07:52 [auto1.it] INFO: Scrape type for UE17288: 0
2026-03-30 09:07:52 [auto1.it] INFO: Found listing with ID: CS05902
2026-03-30 09:07:52 [auto1.it] INFO: Found listing with ID: VB70261
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB70261%27 HTTP/1.1" 200 None
2026-03-30 09:07:52 [auto1.it] INFO: Scrape type for VB70261: 0
2026-03-30 09:07:52 [auto1.it] INFO: Found listing with ID: ZV11200
2026-03-30 09:07:52 [auto1.it] INFO: Found listing with ID: DA61571
2026-03-30 09:07:52 [auto1.it] INFO: Found listing with ID: DX02178
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX02178%27 HTTP/1.1" 200 None
2026-03-30 09:07:52 [auto1.it] INFO: Scrape type for DX02178: 2
2026-03-30 09:07:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a99cf1a6-dbfa-53b5-a054-3338c593f4c8 with identifier: DX02178
2026-03-30 09:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a99cf1a6-dbfa-53b5-a054-3338c593f4c8 with scrape type 2
2026-03-30 09:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a99cf1a6-dbfa-53b5-a054-3338c593f4c8 with scrape type 2
2026-03-30 09:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a99cf1a6-dbfa-53b5-a054-3338c593f4c8, identifier: DX02178
2026-03-30 09:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a99cf1a6-dbfa-53b5-a054-3338c593f4c8 with identifier: DX02178
2026-03-30 09:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a99cf1a6-dbfa-53b5-a054-3338c593f4c8 with identifier: DX02178
2026-03-30 09:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a99cf1a6-dbfa-53b5-a054-3338c593f4c8 with identifier: DX02178 to the API
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:13:12Z',
 'fuel_type': 'diesel',
 'id': 'a99cf1a6-dbfa-53b5-a054-3338c593f4c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX02178',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 166593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-12',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Live',
 'transmission': 'manual',
 'trim': 'Live',
 'year': 2014}
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX02178%27 HTTP/1.1" 200 None
2026-03-30 09:07:53 [auto1.it] INFO: Saving data for DX02178: {'auction_closing_time': 1774883592.0, 'created_time': 1773835353.580987, 'last_price_update_time': 1774861673.412288}
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DX02178') HTTP/1.1" 204 0
2026-03-30 09:07:53 [auto1.it] INFO: Found listing with ID: YG03340
2026-03-30 09:07:53 [auto1.it] INFO: Found listing with ID: FF98619
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF98619%27 HTTP/1.1" 200 None
2026-03-30 09:07:53 [auto1.it] INFO: Scrape type for FF98619: 2
2026-03-30 09:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f798995-e024-5086-b1d3-2d5b4514e60c with identifier: FF98619
2026-03-30 09:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f798995-e024-5086-b1d3-2d5b4514e60c with scrape type 2
2026-03-30 09:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f798995-e024-5086-b1d3-2d5b4514e60c with scrape type 2
2026-03-30 09:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f798995-e024-5086-b1d3-2d5b4514e60c, identifier: FF98619
2026-03-30 09:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f798995-e024-5086-b1d3-2d5b4514e60c with identifier: FF98619
2026-03-30 09:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f798995-e024-5086-b1d3-2d5b4514e60c with identifier: FF98619
2026-03-30 09:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f798995-e024-5086-b1d3-2d5b4514e60c with identifier: FF98619 to the API
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:09:29Z',
 'fuel_type': 'diesel',
 'id': '8f798995-e024-5086-b1d3-2d5b4514e60c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF98619',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 108983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-20',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D4 R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2019}
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF98619%27 HTTP/1.1" 200 None
2026-03-30 09:07:54 [auto1.it] INFO: Saving data for FF98619: {'auction_closing_time': 1774883369.0, 'created_time': 1774342893.582344, 'last_price_update_time': 1774861674.093027}
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FF98619') HTTP/1.1" 204 0
2026-03-30 09:07:54 [auto1.it] INFO: Found listing with ID: YP32890
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP32890%27 HTTP/1.1" 200 None
2026-03-30 09:07:54 [auto1.it] INFO: Scrape type for YP32890: 0
2026-03-30 09:07:54 [auto1.it] INFO: Channel: 24h | Page: 42 | totalHits: 3306 | hits on page: 40
2026-03-30 09:07:54 [auto1.it] INFO: Found listing with ID: YP32890
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP32890%27 HTTP/1.1" 200 None
2026-03-30 09:07:54 [auto1.it] INFO: Scrape type for YP32890: 0
2026-03-30 09:07:54 [auto1.it] INFO: Found listing with ID: NF96122
2026-03-30 09:07:54 [auto1.it] INFO: Found listing with ID: LK74824
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK74824%27 HTTP/1.1" 200 None
2026-03-30 09:07:54 [auto1.it] INFO: Scrape type for LK74824: 2
2026-03-30 09:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09ac24f2-a053-51c3-8f8d-5f7bbcecc0ac with identifier: LK74824
2026-03-30 09:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09ac24f2-a053-51c3-8f8d-5f7bbcecc0ac with scrape type 2
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09ac24f2-a053-51c3-8f8d-5f7bbcecc0ac with scrape type 2
2026-03-30 09:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 09ac24f2-a053-51c3-8f8d-5f7bbcecc0ac, identifier: LK74824
2026-03-30 09:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 09ac24f2-a053-51c3-8f8d-5f7bbcecc0ac with identifier: LK74824
2026-03-30 09:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 09ac24f2-a053-51c3-8f8d-5f7bbcecc0ac with identifier: LK74824
2026-03-30 09:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 09ac24f2-a053-51c3-8f8d-5f7bbcecc0ac with identifier: LK74824 to the API
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:36:28Z',
 'fuel_type': 'diesel',
 'id': '09ac24f2-a053-51c3-8f8d-5f7bbcecc0ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK74824',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 186156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-10',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 SD V6 Autobiography',
 'transmission': 'automatic',
 'trim': 'Autobiography',
 'year': 2014}
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK74824%27 HTTP/1.1" 200 None
2026-03-30 09:07:54 [auto1.it] INFO: Saving data for LK74824: {'auction_closing_time': 1774884988.0, 'created_time': 1773327835.737931, 'last_price_update_time': 1774861674.596066}
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LK74824') HTTP/1.1" 204 0
2026-03-30 09:07:54 [auto1.it] INFO: Found listing with ID: ZJ55913
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ55913%27 HTTP/1.1" 200 None
2026-03-30 09:07:54 [auto1.it] INFO: Scrape type for ZJ55913: 0
2026-03-30 09:07:54 [auto1.it] INFO: Found listing with ID: GN63834
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN63834%27 HTTP/1.1" 200 None
2026-03-30 09:07:54 [auto1.it] INFO: Scrape type for GN63834: 2
2026-03-30 09:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 361a3a23-fa11-5d2c-8ce4-3c7394762930 with identifier: GN63834
2026-03-30 09:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 361a3a23-fa11-5d2c-8ce4-3c7394762930 with scrape type 2
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 361a3a23-fa11-5d2c-8ce4-3c7394762930 with scrape type 2
2026-03-30 09:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 361a3a23-fa11-5d2c-8ce4-3c7394762930, identifier: GN63834
2026-03-30 09:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 361a3a23-fa11-5d2c-8ce4-3c7394762930 with identifier: GN63834
2026-03-30 09:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 361a3a23-fa11-5d2c-8ce4-3c7394762930 with identifier: GN63834
2026-03-30 09:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 361a3a23-fa11-5d2c-8ce4-3c7394762930 with identifier: GN63834 to the API
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:21:49Z',
 'fuel_type': 'diesel',
 'id': '361a3a23-fa11-5d2c-8ce4-3c7394762930',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN63834',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 82780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-27',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2019}
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN63834%27 HTTP/1.1" 200 None
2026-03-30 09:07:55 [auto1.it] INFO: Saving data for GN63834: {'auction_closing_time': 1774884109.0, 'created_time': 1774256423.547333, 'last_price_update_time': 1774861675.052338}
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GN63834') HTTP/1.1" 204 0
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: VL10175
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL10175%27 HTTP/1.1" 200 None
2026-03-30 09:07:55 [auto1.it] INFO: Scrape type for VL10175: 0
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: YS71318
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: CJ66066
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ66066%27 HTTP/1.1" 200 None
2026-03-30 09:07:55 [auto1.it] INFO: Scrape type for CJ66066: 2
2026-03-30 09:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd035635-f34d-5c3f-97ee-c16a7876a403 with identifier: CJ66066
2026-03-30 09:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd035635-f34d-5c3f-97ee-c16a7876a403 with scrape type 2
2026-03-30 09:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd035635-f34d-5c3f-97ee-c16a7876a403 with scrape type 2
2026-03-30 09:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bd035635-f34d-5c3f-97ee-c16a7876a403, identifier: CJ66066
2026-03-30 09:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bd035635-f34d-5c3f-97ee-c16a7876a403 with identifier: CJ66066
2026-03-30 09:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bd035635-f34d-5c3f-97ee-c16a7876a403 with identifier: CJ66066
2026-03-30 09:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bd035635-f34d-5c3f-97ee-c16a7876a403 with identifier: CJ66066 to the API
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:19:44Z',
 'fuel_type': 'diesel',
 'id': 'bd035635-f34d-5c3f-97ee-c16a7876a403',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ66066',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 121483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige 4x4',
 'transmission': 'manual',
 'trim': 'Prestige 4x4',
 'year': 2020}
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ66066%27 HTTP/1.1" 200 None
2026-03-30 09:07:55 [auto1.it] INFO: Saving data for CJ66066: {'auction_closing_time': 1774883984.0, 'created_time': 1773759835.662596, 'last_price_update_time': 1774861675.490827}
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CJ66066') HTTP/1.1" 204 0
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: UR23669
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: DN72005
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: AP13803
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP13803%27 HTTP/1.1" 200 None
2026-03-30 09:07:55 [auto1.it] INFO: Scrape type for AP13803: 0
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: FJ79920
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: CF78450
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF78450%27 HTTP/1.1" 200 None
2026-03-30 09:07:55 [auto1.it] INFO: Scrape type for CF78450: 0
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: DK34642
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: BN52557
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: CM00839
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: TV74767
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: KA06591
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA06591%27 HTTP/1.1" 200 None
2026-03-30 09:07:55 [auto1.it] INFO: Scrape type for KA06591: 2
2026-03-30 09:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35258b39-c1e1-5532-a1fc-eb73e7f7c57c with identifier: KA06591
2026-03-30 09:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35258b39-c1e1-5532-a1fc-eb73e7f7c57c with scrape type 2
2026-03-30 09:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35258b39-c1e1-5532-a1fc-eb73e7f7c57c with scrape type 2
2026-03-30 09:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 35258b39-c1e1-5532-a1fc-eb73e7f7c57c, identifier: KA06591
2026-03-30 09:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 35258b39-c1e1-5532-a1fc-eb73e7f7c57c with identifier: KA06591
2026-03-30 09:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 35258b39-c1e1-5532-a1fc-eb73e7f7c57c with identifier: KA06591
2026-03-30 09:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 35258b39-c1e1-5532-a1fc-eb73e7f7c57c with identifier: KA06591 to the API
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:41:17Z',
 'fuel_type': 'diesel',
 'id': '35258b39-c1e1-5532-a1fc-eb73e7f7c57c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA06591',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 96743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-20',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI Mild-Hybrid quattro advanced',
 'transmission': 'automatic',
 'trim': 'quattro advanced',
 'year': 2021}
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA06591%27 HTTP/1.1" 200 None
2026-03-30 09:07:56 [auto1.it] INFO: Saving data for KA06591: {'auction_closing_time': 1774885277.0, 'created_time': 1774559121.760682, 'last_price_update_time': 1774861676.03053}
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KA06591') HTTP/1.1" 204 0
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: ZA06304
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA06304%27 HTTP/1.1" 200 None
2026-03-30 09:07:56 [auto1.it] INFO: Scrape type for ZA06304: 0
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: LJ91384
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: FL80694
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL80694%27 HTTP/1.1" 200 None
2026-03-30 09:07:56 [auto1.it] INFO: Scrape type for FL80694: 0
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: XC85106
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: YR53882
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR53882%27 HTTP/1.1" 200 None
2026-03-30 09:07:56 [auto1.it] INFO: Scrape type for YR53882: 0
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: KT79218
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT79218%27 HTTP/1.1" 200 None
2026-03-30 09:07:56 [auto1.it] INFO: Scrape type for KT79218: 0
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: FL90232
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: CP26264
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: TT97007
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: GN74108
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: DP39396
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP39396%27 HTTP/1.1" 200 None
2026-03-30 09:07:56 [auto1.it] INFO: Scrape type for DP39396: 0
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: NC00198
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC00198%27 HTTP/1.1" 200 None
2026-03-30 09:07:56 [auto1.it] INFO: Scrape type for NC00198: 2
2026-03-30 09:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e97a6c3-b350-5577-9c94-93e4fdc8d7c6 with identifier: NC00198
2026-03-30 09:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e97a6c3-b350-5577-9c94-93e4fdc8d7c6 with scrape type 2
2026-03-30 09:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e97a6c3-b350-5577-9c94-93e4fdc8d7c6 with scrape type 2
2026-03-30 09:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0e97a6c3-b350-5577-9c94-93e4fdc8d7c6, identifier: NC00198
2026-03-30 09:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0e97a6c3-b350-5577-9c94-93e4fdc8d7c6 with identifier: NC00198
2026-03-30 09:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0e97a6c3-b350-5577-9c94-93e4fdc8d7c6 with identifier: NC00198
2026-03-30 09:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0e97a6c3-b350-5577-9c94-93e4fdc8d7c6 with identifier: NC00198 to the API
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:49:40Z',
 'fuel_type': 'diesel',
 'id': '0e97a6c3-b350-5577-9c94-93e4fdc8d7c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC00198',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 263799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-02',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Summit',
 'transmission': 'automatic',
 'trim': 'Summit',
 'year': 2014}
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC00198%27 HTTP/1.1" 200 None
2026-03-30 09:07:56 [auto1.it] INFO: Saving data for NC00198: {'auction_closing_time': 1774885780.0, 'created_time': 1773848580.644763, 'last_price_update_time': 1774861676.786374}
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NC00198') HTTP/1.1" 204 0
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: HY77897
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY77897%27 HTTP/1.1" 200 None
2026-03-30 09:07:56 [auto1.it] INFO: Scrape type for HY77897: 0
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: AG54549
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: UX44191
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: BW34835
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW34835%27 HTTP/1.1" 200 None
2026-03-30 09:07:56 [auto1.it] INFO: Scrape type for BW34835: 2
2026-03-30 09:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2cf3473-fad7-597b-97f1-1d4faa65967b with identifier: BW34835
2026-03-30 09:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2cf3473-fad7-597b-97f1-1d4faa65967b with scrape type 2
2026-03-30 09:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2cf3473-fad7-597b-97f1-1d4faa65967b with scrape type 2
2026-03-30 09:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f2cf3473-fad7-597b-97f1-1d4faa65967b, identifier: BW34835
2026-03-30 09:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f2cf3473-fad7-597b-97f1-1d4faa65967b with identifier: BW34835
2026-03-30 09:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f2cf3473-fad7-597b-97f1-1d4faa65967b with identifier: BW34835
2026-03-30 09:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f2cf3473-fad7-597b-97f1-1d4faa65967b with identifier: BW34835 to the API
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:52Z',
 'fuel_type': 'diesel',
 'id': 'f2cf3473-fad7-597b-97f1-1d4faa65967b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW34835',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 233877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-11-11',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW34835%27 HTTP/1.1" 200 None
2026-03-30 09:07:57 [auto1.it] INFO: Saving data for BW34835: {'auction_closing_time': 1774885612.0, 'created_time': 1774645588.884798, 'last_price_update_time': 1774861677.368913}
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BW34835') HTTP/1.1" 204 0
2026-03-30 09:07:57 [auto1.it] INFO: Found listing with ID: BW24813
2026-03-30 09:07:57 [auto1.it] INFO: Found listing with ID: JF07503
2026-03-30 09:07:57 [auto1.it] INFO: Found listing with ID: UC47461
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC47461%27 HTTP/1.1" 200 None
2026-03-30 09:07:57 [auto1.it] INFO: Scrape type for UC47461: 0
2026-03-30 09:07:57 [auto1.it] INFO: Found listing with ID: HS75117
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS75117%27 HTTP/1.1" 200 None
2026-03-30 09:07:57 [auto1.it] INFO: Scrape type for HS75117: 0
2026-03-30 09:07:57 [auto1.it] INFO: Found listing with ID: NC89315
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC89315%27 HTTP/1.1" 200 None
2026-03-30 09:07:57 [auto1.it] INFO: Scrape type for NC89315: 0
2026-03-30 09:07:57 [auto1.it] INFO: Found listing with ID: EM22547
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM22547%27 HTTP/1.1" 200 None
2026-03-30 09:07:57 [auto1.it] INFO: Scrape type for EM22547: 0
2026-03-30 09:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:01 [auto1.it] INFO: Channel: 24h | Page: 43 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:01 [auto1.it] INFO: Found listing with ID: AJ89778
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ89778%27 HTTP/1.1" 200 None
2026-03-30 09:08:01 [auto1.it] INFO: Scrape type for AJ89778: 0
2026-03-30 09:08:01 [auto1.it] INFO: Found listing with ID: FR80508
2026-03-30 09:08:01 [auto1.it] INFO: Found listing with ID: YP04797
2026-03-30 09:08:01 [auto1.it] INFO: Found listing with ID: DM32670
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM32670%27 HTTP/1.1" 200 None
2026-03-30 09:08:01 [auto1.it] INFO: Scrape type for DM32670: 0
2026-03-30 09:08:01 [auto1.it] INFO: Found listing with ID: UN42756
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN42756%27 HTTP/1.1" 200 None
2026-03-30 09:08:01 [auto1.it] INFO: Scrape type for UN42756: 2
2026-03-30 09:08:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5324e246-47e8-527c-9783-ea4ac7e30248 with identifier: UN42756
2026-03-30 09:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5324e246-47e8-527c-9783-ea4ac7e30248 with scrape type 2
2026-03-30 09:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5324e246-47e8-527c-9783-ea4ac7e30248 with scrape type 2
2026-03-30 09:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5324e246-47e8-527c-9783-ea4ac7e30248, identifier: UN42756
2026-03-30 09:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5324e246-47e8-527c-9783-ea4ac7e30248 with identifier: UN42756
2026-03-30 09:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5324e246-47e8-527c-9783-ea4ac7e30248 with identifier: UN42756
2026-03-30 09:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5324e246-47e8-527c-9783-ea4ac7e30248 with identifier: UN42756 to the API
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:13:31Z',
 'fuel_type': 'diesel',
 'id': '5324e246-47e8-527c-9783-ea4ac7e30248',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN42756',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 173195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-02',
 'seller_name': None,
 'title': 'Fiat 500X 1.6 JTDM Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN42756%27 HTTP/1.1" 200 None
2026-03-30 09:08:01 [auto1.it] INFO: Saving data for UN42756: {'auction_closing_time': 1774883611.0, 'created_time': 1774558910.250286, 'last_price_update_time': 1774861681.676314}
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UN42756') HTTP/1.1" 204 0
2026-03-30 09:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:01 [auto1.it] INFO: Found listing with ID: PN03774
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN03774%27 HTTP/1.1" 200 None
2026-03-30 09:08:01 [auto1.it] INFO: Scrape type for PN03774: 0
2026-03-30 09:08:01 [auto1.it] INFO: Found listing with ID: UN16063
2026-03-30 09:08:01 [auto1.it] INFO: Found listing with ID: SJ00829
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ00829%27 HTTP/1.1" 200 None
2026-03-30 09:08:01 [auto1.it] INFO: Scrape type for SJ00829: 0
2026-03-30 09:08:01 [auto1.it] INFO: Found listing with ID: MS47082
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS47082%27 HTTP/1.1" 200 None
2026-03-30 09:08:01 [auto1.it] INFO: Scrape type for MS47082: 2
2026-03-30 09:08:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d70570ae-6117-5213-90a8-083de7d3686f with identifier: MS47082
2026-03-30 09:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d70570ae-6117-5213-90a8-083de7d3686f with scrape type 2
2026-03-30 09:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d70570ae-6117-5213-90a8-083de7d3686f with scrape type 2
2026-03-30 09:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d70570ae-6117-5213-90a8-083de7d3686f, identifier: MS47082
2026-03-30 09:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d70570ae-6117-5213-90a8-083de7d3686f with identifier: MS47082
2026-03-30 09:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d70570ae-6117-5213-90a8-083de7d3686f with identifier: MS47082
2026-03-30 09:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d70570ae-6117-5213-90a8-083de7d3686f with identifier: MS47082 to the API
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:00:36Z',
 'fuel_type': 'diesel',
 'id': 'd70570ae-6117-5213-90a8-083de7d3686f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS47082',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 124874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-28',
 'seller_name': None,
 'title': 'Seat Altea 1.6 TDI Style Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Ecomotive',
 'year': 2010}
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS47082%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [auto1.it] INFO: Saving data for MS47082: {'auction_closing_time': 1774882836.0, 'created_time': 1774559037.662994, 'last_price_update_time': 1774861682.245277}
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MS47082') HTTP/1.1" 204 0
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: RM97748
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: NH03785
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH03785%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [auto1.it] INFO: Scrape type for NH03785: 0
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: SM10455
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM10455%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [auto1.it] INFO: Scrape type for SM10455: 2
2026-03-30 09:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c178f2ff-21a2-5137-b819-54564da6aad9 with identifier: SM10455
2026-03-30 09:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c178f2ff-21a2-5137-b819-54564da6aad9 with scrape type 2
2026-03-30 09:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c178f2ff-21a2-5137-b819-54564da6aad9 with scrape type 2
2026-03-30 09:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c178f2ff-21a2-5137-b819-54564da6aad9, identifier: SM10455
2026-03-30 09:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c178f2ff-21a2-5137-b819-54564da6aad9 with identifier: SM10455
2026-03-30 09:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c178f2ff-21a2-5137-b819-54564da6aad9 with identifier: SM10455
2026-03-30 09:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c178f2ff-21a2-5137-b819-54564da6aad9 with identifier: SM10455 to the API
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:25:37Z',
 'fuel_type': 'hybrid',
 'id': 'c178f2ff-21a2-5137-b819-54564da6aad9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM10455',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 8799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-18',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2023}
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM10455%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [auto1.it] INFO: Saving data for SM10455: {'auction_closing_time': 1774884337.0, 'created_time': 1774645593.34811, 'last_price_update_time': 1774861682.707417}
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SM10455') HTTP/1.1" 204 0
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: CV79259
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV79259%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [auto1.it] INFO: Scrape type for CV79259: 0
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: LH97251
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: JX68223
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX68223%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [auto1.it] INFO: Scrape type for JX68223: 0
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: RJ82738
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: KH49254
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: TT50547
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT50547%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [auto1.it] INFO: Scrape type for TT50547: 0
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: JV05910
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV05910%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [auto1.it] INFO: Scrape type for JV05910: 0
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: MA17223
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA17223%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [auto1.it] INFO: Scrape type for MA17223: 2
2026-03-30 09:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9cb7d9c-49be-5208-81ab-8cdd1b9a669f with identifier: MA17223
2026-03-30 09:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9cb7d9c-49be-5208-81ab-8cdd1b9a669f with scrape type 2
2026-03-30 09:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9cb7d9c-49be-5208-81ab-8cdd1b9a669f with scrape type 2
2026-03-30 09:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c9cb7d9c-49be-5208-81ab-8cdd1b9a669f, identifier: MA17223
2026-03-30 09:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c9cb7d9c-49be-5208-81ab-8cdd1b9a669f with identifier: MA17223
2026-03-30 09:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c9cb7d9c-49be-5208-81ab-8cdd1b9a669f with identifier: MA17223
2026-03-30 09:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c9cb7d9c-49be-5208-81ab-8cdd1b9a669f with identifier: MA17223 to the API
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:01:37Z',
 'fuel_type': 'diesel',
 'id': 'c9cb7d9c-49be-5208-81ab-8cdd1b9a669f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA17223',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 163767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 250 CDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2012}
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA17223%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [auto1.it] INFO: Saving data for MA17223: {'auction_closing_time': 1774882897.0, 'created_time': 1773867656.260227, 'last_price_update_time': 1774861683.198}
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MA17223') HTTP/1.1" 204 0
2026-03-30 09:08:03 [auto1.it] INFO: Found listing with ID: PC08204
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC08204%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [auto1.it] INFO: Scrape type for PC08204: 0
2026-03-30 09:08:03 [auto1.it] INFO: Found listing with ID: PV94920
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV94920%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [auto1.it] INFO: Scrape type for PV94920: 0
2026-03-30 09:08:03 [auto1.it] INFO: Found listing with ID: ZW61080
2026-03-30 09:08:03 [auto1.it] INFO: Found listing with ID: DK51991
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK51991%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [auto1.it] INFO: Scrape type for DK51991: 2
2026-03-30 09:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e76171f0-2b6e-58a6-acc2-040064516ac8 with identifier: DK51991
2026-03-30 09:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e76171f0-2b6e-58a6-acc2-040064516ac8 with scrape type 2
2026-03-30 09:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e76171f0-2b6e-58a6-acc2-040064516ac8 with scrape type 2
2026-03-30 09:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e76171f0-2b6e-58a6-acc2-040064516ac8, identifier: DK51991
2026-03-30 09:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e76171f0-2b6e-58a6-acc2-040064516ac8 with identifier: DK51991
2026-03-30 09:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e76171f0-2b6e-58a6-acc2-040064516ac8 with identifier: DK51991
2026-03-30 09:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e76171f0-2b6e-58a6-acc2-040064516ac8 with identifier: DK51991 to the API
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:41:04Z',
 'fuel_type': 'diesel',
 'id': 'e76171f0-2b6e-58a6-acc2-040064516ac8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK51991',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 257848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2018}
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK51991%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [auto1.it] INFO: Saving data for DK51991: {'auction_closing_time': 1774885264.0, 'created_time': 1773305222.958797, 'last_price_update_time': 1774861683.753151}
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DK51991') HTTP/1.1" 204 0
2026-03-30 09:08:03 [auto1.it] INFO: Found listing with ID: GG10303
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG10303%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [auto1.it] INFO: Scrape type for GG10303: 2
2026-03-30 09:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f3e5d53-2c96-5926-a0c8-0415c0c3985e with identifier: GG10303
2026-03-30 09:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f3e5d53-2c96-5926-a0c8-0415c0c3985e with scrape type 2
2026-03-30 09:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f3e5d53-2c96-5926-a0c8-0415c0c3985e with scrape type 2
2026-03-30 09:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f3e5d53-2c96-5926-a0c8-0415c0c3985e, identifier: GG10303
2026-03-30 09:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f3e5d53-2c96-5926-a0c8-0415c0c3985e with identifier: GG10303
2026-03-30 09:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f3e5d53-2c96-5926-a0c8-0415c0c3985e with identifier: GG10303
2026-03-30 09:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f3e5d53-2c96-5926-a0c8-0415c0c3985e with identifier: GG10303 to the API
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:03:09Z',
 'fuel_type': 'diesel',
 'id': '0f3e5d53-2c96-5926-a0c8-0415c0c3985e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG10303',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 261019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-24',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Night Eagle FWD',
 'transmission': 'manual',
 'trim': 'Night Eagle FWD',
 'year': 2017}
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG10303%27 HTTP/1.1" 200 None
2026-03-30 09:08:04 [auto1.it] INFO: Saving data for GG10303: {'auction_closing_time': 1774882989.0, 'created_time': 1774645276.981146, 'last_price_update_time': 1774861684.171581}
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GG10303') HTTP/1.1" 204 0
2026-03-30 09:08:04 [auto1.it] INFO: Found listing with ID: SY54924
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY54924%27 HTTP/1.1" 200 None
2026-03-30 09:08:04 [auto1.it] INFO: Scrape type for SY54924: 0
2026-03-30 09:08:04 [auto1.it] INFO: Found listing with ID: GW48563
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW48563%27 HTTP/1.1" 200 None
2026-03-30 09:08:04 [auto1.it] INFO: Scrape type for GW48563: 0
2026-03-30 09:08:04 [auto1.it] INFO: Found listing with ID: YE38738
2026-03-30 09:08:04 [auto1.it] INFO: Found listing with ID: RN44276
2026-03-30 09:08:04 [auto1.it] INFO: Found listing with ID: JC71555
2026-03-30 09:08:04 [auto1.it] INFO: Found listing with ID: AN07116
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN07116%27 HTTP/1.1" 200 None
2026-03-30 09:08:04 [auto1.it] INFO: Scrape type for AN07116: 2
2026-03-30 09:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d5ac30b-f48f-5911-bd69-39f99e4b882b with identifier: AN07116
2026-03-30 09:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d5ac30b-f48f-5911-bd69-39f99e4b882b with scrape type 2
2026-03-30 09:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d5ac30b-f48f-5911-bd69-39f99e4b882b with scrape type 2
2026-03-30 09:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2d5ac30b-f48f-5911-bd69-39f99e4b882b, identifier: AN07116
2026-03-30 09:08:04 [scrapy.extensions.logstats] INFO: Crawled 275 pages (at 14 pages/min), scraped 557 items (at 46 items/min)
2026-03-30 09:08:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 198MiB
2026-03-30 09:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2d5ac30b-f48f-5911-bd69-39f99e4b882b with identifier: AN07116
2026-03-30 09:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2d5ac30b-f48f-5911-bd69-39f99e4b882b with identifier: AN07116
2026-03-30 09:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2d5ac30b-f48f-5911-bd69-39f99e4b882b with identifier: AN07116 to the API
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:16:20Z',
 'fuel_type': 'diesel',
 'id': '2d5ac30b-f48f-5911-bd69-39f99e4b882b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN07116',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 168358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-20',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2017}
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN07116%27 HTTP/1.1" 200 None
2026-03-30 09:08:05 [auto1.it] INFO: Saving data for AN07116: {'auction_closing_time': 1774883780.0, 'created_time': 1774256562.131047, 'last_price_update_time': 1774861685.59381}
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AN07116') HTTP/1.1" 204 0
2026-03-30 09:08:05 [auto1.it] INFO: Found listing with ID: LH59018
2026-03-30 09:08:05 [auto1.it] INFO: Found listing with ID: XG00486
2026-03-30 09:08:05 [auto1.it] INFO: Found listing with ID: UK64691
2026-03-30 09:08:05 [auto1.it] INFO: Found listing with ID: SG75657
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG75657%27 HTTP/1.1" 200 None
2026-03-30 09:08:05 [auto1.it] INFO: Scrape type for SG75657: 2
2026-03-30 09:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67f4c81d-f84a-5c7d-8b09-ce1d505db269 with identifier: SG75657
2026-03-30 09:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269 with scrape type 2
2026-03-30 09:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269 with scrape type 2
2026-03-30 09:08:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 67f4c81d-f84a-5c7d-8b09-ce1d505db269, identifier: SG75657
2026-03-30 09:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 67f4c81d-f84a-5c7d-8b09-ce1d505db269 with identifier: SG75657
2026-03-30 09:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 67f4c81d-f84a-5c7d-8b09-ce1d505db269 with identifier: SG75657
2026-03-30 09:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 67f4c81d-f84a-5c7d-8b09-ce1d505db269 with identifier: SG75657 to the API
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:52:35Z',
 'fuel_type': 'diesel',
 'id': '67f4c81d-f84a-5c7d-8b09-ce1d505db269',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG75657',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 135710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG75657%27 HTTP/1.1" 200 None
2026-03-30 09:08:06 [auto1.it] INFO: Saving data for SG75657: {'auction_closing_time': 1774885955.0, 'created_time': 1774559105.867522, 'last_price_update_time': 1774861686.103118}
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SG75657') HTTP/1.1" 204 0
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: SF23261
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF23261%27 HTTP/1.1" 200 None
2026-03-30 09:08:06 [auto1.it] INFO: Scrape type for SF23261: 0
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: XW75946
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: SN49105
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: SZ00349
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: UH39950
2026-03-30 09:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:06 [auto1.it] INFO: Channel: 24h | Page: 44 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: RM88416
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: EU38381
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: MA83267
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA83267%27 HTTP/1.1" 200 None
2026-03-30 09:08:06 [auto1.it] INFO: Scrape type for MA83267: 0
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: VY08024
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: AH42596
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: WE98269
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE98269%27 HTTP/1.1" 200 None
2026-03-30 09:08:06 [auto1.it] INFO: Scrape type for WE98269: 0
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: SV89112
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: ZX85690
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX85690%27 HTTP/1.1" 200 None
2026-03-30 09:08:06 [auto1.it] INFO: Scrape type for ZX85690: 0
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: JA21524
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA21524%27 HTTP/1.1" 200 None
2026-03-30 09:08:06 [auto1.it] INFO: Scrape type for JA21524: 2
2026-03-30 09:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaa8b773-36c1-5704-85c0-6980885dfae5 with identifier: JA21524
2026-03-30 09:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaa8b773-36c1-5704-85c0-6980885dfae5 with scrape type 2
2026-03-30 09:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaa8b773-36c1-5704-85c0-6980885dfae5 with scrape type 2
2026-03-30 09:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aaa8b773-36c1-5704-85c0-6980885dfae5, identifier: JA21524
2026-03-30 09:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aaa8b773-36c1-5704-85c0-6980885dfae5 with identifier: JA21524
2026-03-30 09:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aaa8b773-36c1-5704-85c0-6980885dfae5 with identifier: JA21524
2026-03-30 09:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aaa8b773-36c1-5704-85c0-6980885dfae5 with identifier: JA21524 to the API
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:28:38Z',
 'fuel_type': 'diesel',
 'id': 'aaa8b773-36c1-5704-85c0-6980885dfae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA21524',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 226973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-31',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI quattro S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'quattro S line Sportpaket',
 'year': 2014}
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA21524%27 HTTP/1.1" 200 None
2026-03-30 09:08:06 [auto1.it] INFO: Saving data for JA21524: {'auction_closing_time': 1774884518.0, 'created_time': 1773130853.972664, 'last_price_update_time': 1774861686.877405}
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JA21524') HTTP/1.1" 204 0
2026-03-30 09:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: PA07928
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA07928%27 HTTP/1.1" 200 None
2026-03-30 09:08:07 [auto1.it] INFO: Scrape type for PA07928: 2
2026-03-30 09:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2072f613-4d78-568e-98e6-94ba28174786 with identifier: PA07928
2026-03-30 09:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2072f613-4d78-568e-98e6-94ba28174786 with scrape type 2
2026-03-30 09:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2072f613-4d78-568e-98e6-94ba28174786 with scrape type 2
2026-03-30 09:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2072f613-4d78-568e-98e6-94ba28174786, identifier: PA07928
2026-03-30 09:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2072f613-4d78-568e-98e6-94ba28174786 with identifier: PA07928
2026-03-30 09:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2072f613-4d78-568e-98e6-94ba28174786 with identifier: PA07928
2026-03-30 09:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2072f613-4d78-568e-98e6-94ba28174786 with identifier: PA07928 to the API
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:15:43Z',
 'fuel_type': 'diesel',
 'id': '2072f613-4d78-568e-98e6-94ba28174786',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA07928',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 216704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-23',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2013}
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA07928%27 HTTP/1.1" 200 None
2026-03-30 09:08:07 [auto1.it] INFO: Saving data for PA07928: {'auction_closing_time': 1774883743.0, 'created_time': 1773305157.634485, 'last_price_update_time': 1774861687.393531}
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PA07928') HTTP/1.1" 204 0
2026-03-30 09:08:07 [auto1.it] INFO: Found listing with ID: LW29692
2026-03-30 09:08:07 [auto1.it] INFO: Found listing with ID: RF58149
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF58149%27 HTTP/1.1" 200 None
2026-03-30 09:08:07 [auto1.it] INFO: Scrape type for RF58149: 2
2026-03-30 09:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162a4470-6889-571d-a0f4-89b1985e2509 with identifier: RF58149
2026-03-30 09:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162a4470-6889-571d-a0f4-89b1985e2509 with scrape type 2
2026-03-30 09:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 162a4470-6889-571d-a0f4-89b1985e2509 with scrape type 2
2026-03-30 09:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 162a4470-6889-571d-a0f4-89b1985e2509, identifier: RF58149
2026-03-30 09:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 162a4470-6889-571d-a0f4-89b1985e2509 with identifier: RF58149
2026-03-30 09:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 162a4470-6889-571d-a0f4-89b1985e2509 with identifier: RF58149
2026-03-30 09:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 162a4470-6889-571d-a0f4-89b1985e2509 with identifier: RF58149 to the API
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:33:28Z',
 'fuel_type': 'petrol',
 'id': '162a4470-6889-571d-a0f4-89b1985e2509',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF58149',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 179527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-19',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2015}
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF58149%27 HTTP/1.1" 200 None
2026-03-30 09:08:07 [auto1.it] INFO: Saving data for RF58149: {'auction_closing_time': 1774884808.0, 'created_time': 1774342915.89903, 'last_price_update_time': 1774861687.801858}
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF58149') HTTP/1.1" 204 0
2026-03-30 09:08:07 [auto1.it] INFO: Found listing with ID: LY31332
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY31332%27 HTTP/1.1" 200 None
2026-03-30 09:08:07 [auto1.it] INFO: Scrape type for LY31332: 0
2026-03-30 09:08:07 [auto1.it] INFO: Found listing with ID: KP29994
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP29994%27 HTTP/1.1" 200 None
2026-03-30 09:08:07 [auto1.it] INFO: Scrape type for KP29994: 0
2026-03-30 09:08:07 [auto1.it] INFO: Found listing with ID: BJ69368
2026-03-30 09:08:07 [auto1.it] INFO: Found listing with ID: XF08656
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF08656%27 HTTP/1.1" 200 None
2026-03-30 09:08:07 [auto1.it] INFO: Scrape type for XF08656: 0
2026-03-30 09:08:07 [auto1.it] INFO: Found listing with ID: WY54071
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY54071%27 HTTP/1.1" 200 None
2026-03-30 09:08:07 [auto1.it] INFO: Scrape type for WY54071: 2
2026-03-30 09:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7b56812-17d6-5443-a651-bb4cee4e9d81 with identifier: WY54071
2026-03-30 09:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7b56812-17d6-5443-a651-bb4cee4e9d81 with scrape type 2
2026-03-30 09:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7b56812-17d6-5443-a651-bb4cee4e9d81 with scrape type 2
2026-03-30 09:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a7b56812-17d6-5443-a651-bb4cee4e9d81, identifier: WY54071
2026-03-30 09:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a7b56812-17d6-5443-a651-bb4cee4e9d81 with identifier: WY54071
2026-03-30 09:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a7b56812-17d6-5443-a651-bb4cee4e9d81 with identifier: WY54071
2026-03-30 09:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a7b56812-17d6-5443-a651-bb4cee4e9d81 with identifier: WY54071 to the API
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:32:01Z',
 'fuel_type': 'diesel',
 'id': 'a7b56812-17d6-5443-a651-bb4cee4e9d81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY54071',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 155811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-20',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi XPossible 2WD',
 'transmission': 'manual',
 'trim': 'XPossible 2WD',
 'year': 2013}
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY54071%27 HTTP/1.1" 200 None
2026-03-30 09:08:08 [auto1.it] INFO: Saving data for WY54071: {'auction_closing_time': 1774884721.0, 'created_time': 1773738218.901736, 'last_price_update_time': 1774861688.270204}
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WY54071') HTTP/1.1" 204 0
2026-03-30 09:08:08 [auto1.it] INFO: Found listing with ID: BD54797
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD54797%27 HTTP/1.1" 200 None
2026-03-30 09:08:08 [auto1.it] INFO: Scrape type for BD54797: 2
2026-03-30 09:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c49df124-78fd-55b5-ac93-189527429097 with identifier: BD54797
2026-03-30 09:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c49df124-78fd-55b5-ac93-189527429097 with scrape type 2
2026-03-30 09:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c49df124-78fd-55b5-ac93-189527429097 with scrape type 2
2026-03-30 09:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c49df124-78fd-55b5-ac93-189527429097, identifier: BD54797
2026-03-30 09:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c49df124-78fd-55b5-ac93-189527429097 with identifier: BD54797
2026-03-30 09:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c49df124-78fd-55b5-ac93-189527429097 with identifier: BD54797
2026-03-30 09:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c49df124-78fd-55b5-ac93-189527429097 with identifier: BD54797 to the API
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:01:43Z',
 'fuel_type': 'diesel',
 'id': 'c49df124-78fd-55b5-ac93-189527429097',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD54797',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 239471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2017}
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD54797%27 HTTP/1.1" 200 None
2026-03-30 09:08:08 [auto1.it] INFO: Saving data for BD54797: {'auction_closing_time': 1774882903.0, 'created_time': 1773349342.573278, 'last_price_update_time': 1774861688.691717}
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BD54797') HTTP/1.1" 204 0
2026-03-30 09:08:08 [auto1.it] INFO: Found listing with ID: CD59978
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD59978%27 HTTP/1.1" 200 None
2026-03-30 09:08:08 [auto1.it] INFO: Scrape type for CD59978: 2
2026-03-30 09:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e123633-8e8e-56d9-9e37-7870d3311c3d with identifier: CD59978
2026-03-30 09:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e123633-8e8e-56d9-9e37-7870d3311c3d with scrape type 2
2026-03-30 09:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e123633-8e8e-56d9-9e37-7870d3311c3d with scrape type 2
2026-03-30 09:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e123633-8e8e-56d9-9e37-7870d3311c3d, identifier: CD59978
2026-03-30 09:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e123633-8e8e-56d9-9e37-7870d3311c3d with identifier: CD59978
2026-03-30 09:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e123633-8e8e-56d9-9e37-7870d3311c3d with identifier: CD59978
2026-03-30 09:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6e123633-8e8e-56d9-9e37-7870d3311c3d with identifier: CD59978 to the API
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:40:18Z',
 'fuel_type': 'hybrid',
 'id': '6e123633-8e8e-56d9-9e37-7870d3311c3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD59978',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 302103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 1.8 Hybrid Black Edition',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2017}
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD59978%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Saving data for CD59978: {'auction_closing_time': 1774885218.0, 'created_time': 1774645626.892869, 'last_price_update_time': 1774861689.115438}
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CD59978') HTTP/1.1" 204 0
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: TA36833
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: LX42454
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX42454%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Scrape type for LX42454: 0
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: ZT44032
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: TD38619
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: GT16147
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: LN05453
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN05453%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Scrape type for LN05453: 0
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: VA41104
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA41104%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Scrape type for VA41104: 0
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: ES59878
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES59878%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Scrape type for ES59878: 0
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: ZT67877
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: DJ48929
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ48929%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Scrape type for DJ48929: 0
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: DV09922
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV09922%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Scrape type for DV09922: 0
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: UW92889
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW92889%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Scrape type for UW92889: 0
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: NJ63404
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: HV87754
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: TJ75665
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ75665%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Scrape type for TJ75665: 0
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: TV86323
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: DM40972
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM40972%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Scrape type for DM40972: 2
2026-03-30 09:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8a32018-c986-5303-ba17-5b0ab1b2e707 with identifier: DM40972
2026-03-30 09:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8a32018-c986-5303-ba17-5b0ab1b2e707 with scrape type 2
2026-03-30 09:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8a32018-c986-5303-ba17-5b0ab1b2e707 with scrape type 2
2026-03-30 09:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f8a32018-c986-5303-ba17-5b0ab1b2e707, identifier: DM40972
2026-03-30 09:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f8a32018-c986-5303-ba17-5b0ab1b2e707 with identifier: DM40972
2026-03-30 09:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f8a32018-c986-5303-ba17-5b0ab1b2e707 with identifier: DM40972
2026-03-30 09:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f8a32018-c986-5303-ba17-5b0ab1b2e707 with identifier: DM40972 to the API
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:42:27Z',
 'fuel_type': 'petrol',
 'id': 'f8a32018-c986-5303-ba17-5b0ab1b2e707',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM40972',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 224159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-29',
 'seller_name': None,
 'title': 'Mazda 2 1.3 Independence',
 'transmission': 'manual',
 'trim': 'Independence',
 'year': 2010}
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM40972%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Saving data for DM40972: {'auction_closing_time': 1774885347.0, 'created_time': 1774645628.472231, 'last_price_update_time': 1774861689.70257}
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DM40972') HTTP/1.1" 204 0
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: TH27811
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: RL48638
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: TC65145
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: MB12953
2026-03-30 09:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:10 [auto1.it] INFO: Channel: 24h | Page: 45 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: YB75201
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB75201%27 HTTP/1.1" 200 None
2026-03-30 09:08:10 [auto1.it] INFO: Scrape type for YB75201: 0
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: JR93194
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR93194%27 HTTP/1.1" 200 None
2026-03-30 09:08:10 [auto1.it] INFO: Scrape type for JR93194: 0
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: ZM66429
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: DC70843
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC70843%27 HTTP/1.1" 200 None
2026-03-30 09:08:10 [auto1.it] INFO: Scrape type for DC70843: 0
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: ZW84587
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW84587%27 HTTP/1.1" 200 None
2026-03-30 09:08:10 [auto1.it] INFO: Scrape type for ZW84587: 0
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: WU80477
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: NF87616
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: AL30811
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: UT43750
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: AF97148
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: ZU39445
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: KA22424
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA22424%27 HTTP/1.1" 200 None
2026-03-30 09:08:10 [auto1.it] INFO: Scrape type for KA22424: 0
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: AM53032
2026-03-30 09:08:10 [auto1.it] INFO: Found listing with ID: ZU37783
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU37783%27 HTTP/1.1" 200 None
2026-03-30 09:08:10 [auto1.it] INFO: Scrape type for ZU37783: 2
2026-03-30 09:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 760b5c0d-aa10-5670-badf-f8dc9705090a with identifier: ZU37783
2026-03-30 09:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 760b5c0d-aa10-5670-badf-f8dc9705090a with scrape type 2
2026-03-30 09:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 760b5c0d-aa10-5670-badf-f8dc9705090a with scrape type 2
2026-03-30 09:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 760b5c0d-aa10-5670-badf-f8dc9705090a, identifier: ZU37783
2026-03-30 09:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 760b5c0d-aa10-5670-badf-f8dc9705090a with identifier: ZU37783
2026-03-30 09:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 760b5c0d-aa10-5670-badf-f8dc9705090a with identifier: ZU37783
2026-03-30 09:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 760b5c0d-aa10-5670-badf-f8dc9705090a with identifier: ZU37783 to the API
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:11:44Z',
 'fuel_type': 'diesel',
 'id': '760b5c0d-aa10-5670-badf-f8dc9705090a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU37783',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 230559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-28',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Classic blue 2WD',
 'transmission': 'manual',
 'trim': 'Classic blue 2WD',
 'year': 2016}
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU37783%27 HTTP/1.1" 200 None
2026-03-30 09:08:11 [auto1.it] INFO: Saving data for ZU37783: {'auction_closing_time': 1774883504.0, 'created_time': 1773867694.759177, 'last_price_update_time': 1774861691.105155}
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU37783') HTTP/1.1" 204 0
2026-03-30 09:08:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:11 [auto1.it] INFO: Found listing with ID: GC28590
2026-03-30 09:08:11 [auto1.it] INFO: Found listing with ID: XF95831
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF95831%27 HTTP/1.1" 200 None
2026-03-30 09:08:11 [auto1.it] INFO: Scrape type for XF95831: 0
2026-03-30 09:08:11 [auto1.it] INFO: Found listing with ID: WW13816
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW13816%27 HTTP/1.1" 200 None
2026-03-30 09:08:11 [auto1.it] INFO: Scrape type for WW13816: 2
2026-03-30 09:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f142117-e6b8-539f-9a60-d16789ec09a3 with identifier: WW13816
2026-03-30 09:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f142117-e6b8-539f-9a60-d16789ec09a3 with scrape type 2
2026-03-30 09:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f142117-e6b8-539f-9a60-d16789ec09a3 with scrape type 2
2026-03-30 09:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f142117-e6b8-539f-9a60-d16789ec09a3, identifier: WW13816
2026-03-30 09:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f142117-e6b8-539f-9a60-d16789ec09a3 with identifier: WW13816
2026-03-30 09:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f142117-e6b8-539f-9a60-d16789ec09a3 with identifier: WW13816
2026-03-30 09:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2f142117-e6b8-539f-9a60-d16789ec09a3 with identifier: WW13816 to the API
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:58:05Z',
 'fuel_type': 'diesel',
 'id': '2f142117-e6b8-539f-9a60-d16789ec09a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW13816',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 189537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-31',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2013}
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW13816%27 HTTP/1.1" 200 None
2026-03-30 09:08:11 [auto1.it] INFO: Saving data for WW13816: {'auction_closing_time': 1774886285.0, 'created_time': 1774559184.766331, 'last_price_update_time': 1774861691.634073}
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW13816') HTTP/1.1" 204 0
2026-03-30 09:08:11 [auto1.it] INFO: Found listing with ID: CR75802
2026-03-30 09:08:11 [auto1.it] INFO: Found listing with ID: FN78187
2026-03-30 09:08:11 [auto1.it] INFO: Found listing with ID: ZV13161
2026-03-30 09:08:11 [auto1.it] INFO: Found listing with ID: GY86444
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY86444%27 HTTP/1.1" 200 None
2026-03-30 09:08:11 [auto1.it] INFO: Scrape type for GY86444: 2
2026-03-30 09:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c57cdf46-a48d-5a89-8ebe-193eb23339f6 with identifier: GY86444
2026-03-30 09:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c57cdf46-a48d-5a89-8ebe-193eb23339f6 with scrape type 2
2026-03-30 09:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c57cdf46-a48d-5a89-8ebe-193eb23339f6 with scrape type 2
2026-03-30 09:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c57cdf46-a48d-5a89-8ebe-193eb23339f6, identifier: GY86444
2026-03-30 09:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c57cdf46-a48d-5a89-8ebe-193eb23339f6 with identifier: GY86444
2026-03-30 09:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c57cdf46-a48d-5a89-8ebe-193eb23339f6 with identifier: GY86444
2026-03-30 09:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c57cdf46-a48d-5a89-8ebe-193eb23339f6 with identifier: GY86444 to the API
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:12:44Z',
 'fuel_type': 'diesel',
 'id': 'c57cdf46-a48d-5a89-8ebe-193eb23339f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY86444',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 170545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2013}
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY86444%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Saving data for GY86444: {'auction_closing_time': 1774883564.0, 'created_time': 1774645589.217858, 'last_price_update_time': 1774861692.042121}
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY86444') HTTP/1.1" 204 0
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: SE74727
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE74727%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Scrape type for SE74727: 2
2026-03-30 09:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1 with identifier: SE74727
2026-03-30 09:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1 with scrape type 2
2026-03-30 09:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1 with scrape type 2
2026-03-30 09:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1, identifier: SE74727
2026-03-30 09:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1 with identifier: SE74727
2026-03-30 09:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1 with identifier: SE74727
2026-03-30 09:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1 with identifier: SE74727 to the API
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:01:42Z',
 'fuel_type': 'hybrid',
 'id': '045ade15-e9cc-50e2-ade8-bb89d9ba3ed1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE74727',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 123900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seller_name': None,
 'title': 'Kia Niro 1.6 Plug-in Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE74727%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Saving data for SE74727: {'auction_closing_time': 1774882902.0, 'created_time': 1774645625.649312, 'last_price_update_time': 1774861692.446378}
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SE74727') HTTP/1.1" 204 0
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: DC79490
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: HJ71706
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ71706%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Scrape type for HJ71706: 0
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: ZW42216
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: WP65731
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP65731%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Scrape type for WP65731: 0
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: FG66384
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: MC91027
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: CN54432
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN54432%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Scrape type for CN54432: 0
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: NL99769
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL99769%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Scrape type for NL99769: 0
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: MZ97051
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: DW35808
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: DW91233
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW91233%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Scrape type for DW91233: 0
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: BF95758
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: FT00845
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT00845%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Scrape type for FT00845: 2
2026-03-30 09:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ba80537-3442-5da5-8868-fa2e2a0155b9 with identifier: FT00845
2026-03-30 09:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ba80537-3442-5da5-8868-fa2e2a0155b9 with scrape type 2
2026-03-30 09:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ba80537-3442-5da5-8868-fa2e2a0155b9 with scrape type 2
2026-03-30 09:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9ba80537-3442-5da5-8868-fa2e2a0155b9, identifier: FT00845
2026-03-30 09:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9ba80537-3442-5da5-8868-fa2e2a0155b9 with identifier: FT00845
2026-03-30 09:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9ba80537-3442-5da5-8868-fa2e2a0155b9 with identifier: FT00845
2026-03-30 09:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9ba80537-3442-5da5-8868-fa2e2a0155b9 with identifier: FT00845 to the API
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:52:44Z',
 'fuel_type': 'diesel',
 'id': '9ba80537-3442-5da5-8868-fa2e2a0155b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT00845',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 105566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-28',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT00845%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Saving data for FT00845: {'auction_closing_time': 1774885964.0, 'created_time': 1774645653.492871, 'last_price_update_time': 1774861692.991229}
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FT00845') HTTP/1.1" 204 0
2026-03-30 09:08:13 [auto1.it] INFO: Found listing with ID: RG91775
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG91775%27 HTTP/1.1" 200 None
2026-03-30 09:08:13 [auto1.it] INFO: Scrape type for RG91775: 0
2026-03-30 09:08:13 [auto1.it] INFO: Found listing with ID: ZF37954
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF37954%27 HTTP/1.1" 200 None
2026-03-30 09:08:13 [auto1.it] INFO: Scrape type for ZF37954: 0
2026-03-30 09:08:13 [auto1.it] INFO: Found listing with ID: RG06778
2026-03-30 09:08:13 [auto1.it] INFO: Found listing with ID: PS40086
2026-03-30 09:08:13 [auto1.it] INFO: Found listing with ID: LB35454
2026-03-30 09:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:14 [auto1.it] INFO: Channel: 24h | Page: 46 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:14 [auto1.it] INFO: Found listing with ID: XH07717
2026-03-30 09:08:14 [auto1.it] INFO: Found listing with ID: FC72088
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC72088%27 HTTP/1.1" 200 None
2026-03-30 09:08:14 [auto1.it] INFO: Scrape type for FC72088: 0
2026-03-30 09:08:14 [auto1.it] INFO: Found listing with ID: XY56734
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY56734%27 HTTP/1.1" 200 None
2026-03-30 09:08:14 [auto1.it] INFO: Scrape type for XY56734: 0
2026-03-30 09:08:14 [auto1.it] INFO: Found listing with ID: HU04780
2026-03-30 09:08:14 [auto1.it] INFO: Found listing with ID: RF41966
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF41966%27 HTTP/1.1" 200 None
2026-03-30 09:08:14 [auto1.it] INFO: Scrape type for RF41966: 2
2026-03-30 09:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41c1ea96-c438-553e-9689-610bf4362891 with identifier: RF41966
2026-03-30 09:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c1ea96-c438-553e-9689-610bf4362891 with scrape type 2
2026-03-30 09:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41c1ea96-c438-553e-9689-610bf4362891 with scrape type 2
2026-03-30 09:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 41c1ea96-c438-553e-9689-610bf4362891, identifier: RF41966
2026-03-30 09:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 41c1ea96-c438-553e-9689-610bf4362891 with identifier: RF41966
2026-03-30 09:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 41c1ea96-c438-553e-9689-610bf4362891 with identifier: RF41966
2026-03-30 09:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 41c1ea96-c438-553e-9689-610bf4362891 with identifier: RF41966 to the API
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:09:45Z',
 'fuel_type': 'petrol',
 'id': '41c1ea96-c438-553e-9689-610bf4362891',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF41966',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 138677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-29',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2008}
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF41966%27 HTTP/1.1" 200 None
2026-03-30 09:08:15 [auto1.it] INFO: Saving data for RF41966: {'auction_closing_time': 1774883385.0, 'created_time': 1774559130.939238, 'last_price_update_time': 1774861695.229843}
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF41966') HTTP/1.1" 204 0
2026-03-30 09:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:15 [auto1.it] INFO: Found listing with ID: UH63202
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH63202%27 HTTP/1.1" 200 None
2026-03-30 09:08:15 [auto1.it] INFO: Scrape type for UH63202: 2
2026-03-30 09:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9f78161-b0b1-558f-972d-3b4d739eacea with identifier: UH63202
2026-03-30 09:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9f78161-b0b1-558f-972d-3b4d739eacea with scrape type 2
2026-03-30 09:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9f78161-b0b1-558f-972d-3b4d739eacea with scrape type 2
2026-03-30 09:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d9f78161-b0b1-558f-972d-3b4d739eacea, identifier: UH63202
2026-03-30 09:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d9f78161-b0b1-558f-972d-3b4d739eacea with identifier: UH63202
2026-03-30 09:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d9f78161-b0b1-558f-972d-3b4d739eacea with identifier: UH63202
2026-03-30 09:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d9f78161-b0b1-558f-972d-3b4d739eacea with identifier: UH63202 to the API
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:17Z',
 'fuel_type': 'diesel',
 'id': 'd9f78161-b0b1-558f-972d-3b4d739eacea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH63202',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 192250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-06',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D3 Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2015}
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH63202%27 HTTP/1.1" 200 None
2026-03-30 09:08:15 [auto1.it] INFO: Saving data for UH63202: {'auction_closing_time': 1774883717.0, 'created_time': 1774558861.683441, 'last_price_update_time': 1774861695.681574}
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UH63202') HTTP/1.1" 204 0
2026-03-30 09:08:15 [auto1.it] INFO: Found listing with ID: WK88793
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK88793%27 HTTP/1.1" 200 None
2026-03-30 09:08:15 [auto1.it] INFO: Scrape type for WK88793: 0
2026-03-30 09:08:15 [auto1.it] INFO: Found listing with ID: VY30881
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY30881%27 HTTP/1.1" 200 None
2026-03-30 09:08:15 [auto1.it] INFO: Scrape type for VY30881: 0
2026-03-30 09:08:15 [auto1.it] INFO: Found listing with ID: JV49964
2026-03-30 09:08:15 [auto1.it] INFO: Found listing with ID: FG41149
2026-03-30 09:08:15 [auto1.it] INFO: Found listing with ID: HE58096
2026-03-30 09:08:15 [auto1.it] INFO: Found listing with ID: HY50336
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY50336%27 HTTP/1.1" 200 None
2026-03-30 09:08:15 [auto1.it] INFO: Scrape type for HY50336: 0
2026-03-30 09:08:15 [auto1.it] INFO: Found listing with ID: YM68683
2026-03-30 09:08:15 [auto1.it] INFO: Found listing with ID: AK04319
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK04319%27 HTTP/1.1" 200 None
2026-03-30 09:08:15 [auto1.it] INFO: Scrape type for AK04319: 2
2026-03-30 09:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dbc3aeb-e8fd-5f93-ab53-d0f4943aeea3 with identifier: AK04319
2026-03-30 09:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dbc3aeb-e8fd-5f93-ab53-d0f4943aeea3 with scrape type 2
2026-03-30 09:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dbc3aeb-e8fd-5f93-ab53-d0f4943aeea3 with scrape type 2
2026-03-30 09:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4dbc3aeb-e8fd-5f93-ab53-d0f4943aeea3, identifier: AK04319
2026-03-30 09:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4dbc3aeb-e8fd-5f93-ab53-d0f4943aeea3 with identifier: AK04319
2026-03-30 09:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4dbc3aeb-e8fd-5f93-ab53-d0f4943aeea3 with identifier: AK04319
2026-03-30 09:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4dbc3aeb-e8fd-5f93-ab53-d0f4943aeea3 with identifier: AK04319 to the API
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:51:17Z',
 'fuel_type': 'petrol',
 'id': '4dbc3aeb-e8fd-5f93-ab53-d0f4943aeea3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK04319',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 170914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-19',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.2 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2011}
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK04319%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [auto1.it] INFO: Saving data for AK04319: {'auction_closing_time': 1774885877.0, 'created_time': 1773327720.404709, 'last_price_update_time': 1774861696.244244}
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AK04319') HTTP/1.1" 204 0
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: BR57787
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR57787%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [auto1.it] INFO: Scrape type for BR57787: 0
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: EW75020
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: JU21728
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: BD43330
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: SS18980
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS18980%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [auto1.it] INFO: Scrape type for SS18980: 2
2026-03-30 09:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0838869c-31af-5ad6-bc1f-e8247551da59 with identifier: SS18980
2026-03-30 09:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0838869c-31af-5ad6-bc1f-e8247551da59 with scrape type 2
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0838869c-31af-5ad6-bc1f-e8247551da59 with scrape type 2
2026-03-30 09:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0838869c-31af-5ad6-bc1f-e8247551da59, identifier: SS18980
2026-03-30 09:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0838869c-31af-5ad6-bc1f-e8247551da59 with identifier: SS18980
2026-03-30 09:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0838869c-31af-5ad6-bc1f-e8247551da59 with identifier: SS18980
2026-03-30 09:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0838869c-31af-5ad6-bc1f-e8247551da59 with identifier: SS18980 to the API
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:37:21Z',
 'fuel_type': 'hybrid',
 'id': '0838869c-31af-5ad6-bc1f-e8247551da59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS18980',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 55894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-15',
 'seller_name': None,
 'title': 'Honda HR-V 1.5 i-MMD Hybrid Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS18980%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [auto1.it] INFO: Saving data for SS18980: {'auction_closing_time': 1774885041.0, 'created_time': 1773867647.341459, 'last_price_update_time': 1774861696.73415}
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SS18980') HTTP/1.1" 204 0
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: PA42280
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: WP88184
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: FT22704
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT22704%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [auto1.it] INFO: Scrape type for FT22704: 0
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: YS49191
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS49191%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [auto1.it] INFO: Scrape type for YS49191: 0
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: LT75746
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT75746%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [auto1.it] INFO: Scrape type for LT75746: 0
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: WS24501
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS24501%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [auto1.it] INFO: Scrape type for WS24501: 2
2026-03-30 09:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc30c7b2-bbdb-5168-ac62-89c569003884 with identifier: WS24501
2026-03-30 09:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc30c7b2-bbdb-5168-ac62-89c569003884 with scrape type 2
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc30c7b2-bbdb-5168-ac62-89c569003884 with scrape type 2
2026-03-30 09:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bc30c7b2-bbdb-5168-ac62-89c569003884, identifier: WS24501
2026-03-30 09:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bc30c7b2-bbdb-5168-ac62-89c569003884 with identifier: WS24501
2026-03-30 09:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bc30c7b2-bbdb-5168-ac62-89c569003884 with identifier: WS24501
2026-03-30 09:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bc30c7b2-bbdb-5168-ac62-89c569003884 with identifier: WS24501 to the API
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:51Z',
 'fuel_type': 'diesel',
 'id': 'bc30c7b2-bbdb-5168-ac62-89c569003884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS24501',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 176584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-24',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 d BlueTEC Executive',
 'transmission': 'manual',
 'trim': 'BlueTEC Executive',
 'year': 2016}
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS24501%27 HTTP/1.1" 200 None
2026-03-30 09:08:17 [auto1.it] INFO: Saving data for WS24501: {'auction_closing_time': 1774884591.0, 'created_time': 1772783800.995986, 'last_price_update_time': 1774861697.656585}
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WS24501') HTTP/1.1" 204 0
2026-03-30 09:08:17 [auto1.it] INFO: Found listing with ID: CS16004
2026-03-30 09:08:17 [auto1.it] INFO: Found listing with ID: LY57551
2026-03-30 09:08:17 [auto1.it] INFO: Found listing with ID: HA44632
2026-03-30 09:08:17 [auto1.it] INFO: Found listing with ID: JS42398
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS42398%27 HTTP/1.1" 200 None
2026-03-30 09:08:17 [auto1.it] INFO: Scrape type for JS42398: 2
2026-03-30 09:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9bac395-e7b7-5990-98f1-187cc017448a with identifier: JS42398
2026-03-30 09:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9bac395-e7b7-5990-98f1-187cc017448a with scrape type 2
2026-03-30 09:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9bac395-e7b7-5990-98f1-187cc017448a with scrape type 2
2026-03-30 09:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e9bac395-e7b7-5990-98f1-187cc017448a, identifier: JS42398
2026-03-30 09:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e9bac395-e7b7-5990-98f1-187cc017448a with identifier: JS42398
2026-03-30 09:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e9bac395-e7b7-5990-98f1-187cc017448a with identifier: JS42398
2026-03-30 09:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e9bac395-e7b7-5990-98f1-187cc017448a with identifier: JS42398 to the API
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:18:06Z',
 'fuel_type': 'diesel',
 'id': 'e9bac395-e7b7-5990-98f1-187cc017448a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS42398',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 200759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-19',
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 2.0 D2 Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2015}
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS42398%27 HTTP/1.1" 200 None
2026-03-30 09:08:18 [auto1.it] INFO: Saving data for JS42398: {'auction_closing_time': 1774883886.0, 'created_time': 1773135862.772643, 'last_price_update_time': 1774861698.108245}
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JS42398') HTTP/1.1" 204 0
2026-03-30 09:08:18 [auto1.it] INFO: Found listing with ID: EN82101
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN82101%27 HTTP/1.1" 200 None
2026-03-30 09:08:18 [auto1.it] INFO: Scrape type for EN82101: 2
2026-03-30 09:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b3fdfed-8c69-50e5-93be-ed1c07bae2c1 with identifier: EN82101
2026-03-30 09:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b3fdfed-8c69-50e5-93be-ed1c07bae2c1 with scrape type 2
2026-03-30 09:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b3fdfed-8c69-50e5-93be-ed1c07bae2c1 with scrape type 2
2026-03-30 09:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2b3fdfed-8c69-50e5-93be-ed1c07bae2c1, identifier: EN82101
2026-03-30 09:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2b3fdfed-8c69-50e5-93be-ed1c07bae2c1 with identifier: EN82101
2026-03-30 09:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2b3fdfed-8c69-50e5-93be-ed1c07bae2c1 with identifier: EN82101
2026-03-30 09:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2b3fdfed-8c69-50e5-93be-ed1c07bae2c1 with identifier: EN82101 to the API
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:01:35Z',
 'fuel_type': 'diesel',
 'id': '2b3fdfed-8c69-50e5-93be-ed1c07bae2c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN82101',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 204959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN82101%27 HTTP/1.1" 200 None
2026-03-30 09:08:18 [auto1.it] INFO: Saving data for EN82101: {'auction_closing_time': 1774882895.0, 'created_time': 1774558952.293012, 'last_price_update_time': 1774861698.58145}
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EN82101') HTTP/1.1" 204 0
2026-03-30 09:08:18 [auto1.it] INFO: Found listing with ID: FU42856
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU42856%27 HTTP/1.1" 200 None
2026-03-30 09:08:18 [auto1.it] INFO: Scrape type for FU42856: 0
2026-03-30 09:08:18 [auto1.it] INFO: Found listing with ID: LW40364
2026-03-30 09:08:18 [auto1.it] INFO: Found listing with ID: HU53243
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU53243%27 HTTP/1.1" 200 None
2026-03-30 09:08:18 [auto1.it] INFO: Scrape type for HU53243: 2
2026-03-30 09:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5407679-a98d-5be6-8e24-4a2282f6aaed with identifier: HU53243
2026-03-30 09:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5407679-a98d-5be6-8e24-4a2282f6aaed with scrape type 2
2026-03-30 09:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5407679-a98d-5be6-8e24-4a2282f6aaed with scrape type 2
2026-03-30 09:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5407679-a98d-5be6-8e24-4a2282f6aaed, identifier: HU53243
2026-03-30 09:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5407679-a98d-5be6-8e24-4a2282f6aaed with identifier: HU53243
2026-03-30 09:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5407679-a98d-5be6-8e24-4a2282f6aaed with identifier: HU53243
2026-03-30 09:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5407679-a98d-5be6-8e24-4a2282f6aaed with identifier: HU53243 to the API
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:49:47Z',
 'fuel_type': 'diesel',
 'id': 'a5407679-a98d-5be6-8e24-4a2282f6aaed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU53243',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat Alltrack',
 'odometer': 125551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seller_name': None,
 'title': 'Volkswagen Passat Alltrack 2.0 TDI 4Motion',
 'transmission': 'automatic',
 'trim': '4Motion',
 'year': 2021}
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU53243%27 HTTP/1.1" 200 None
2026-03-30 09:08:19 [auto1.it] INFO: Saving data for HU53243: {'auction_closing_time': 1774885787.0, 'created_time': 1774559132.695703, 'last_price_update_time': 1774861699.268901}
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU53243') HTTP/1.1" 204 0
2026-03-30 09:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:19 [auto1.it] INFO: Found listing with ID: RB41794
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB41794%27 HTTP/1.1" 200 None
2026-03-30 09:08:19 [auto1.it] INFO: Scrape type for RB41794: 0
2026-03-30 09:08:19 [auto1.it] INFO: Found listing with ID: CP99007
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP99007%27 HTTP/1.1" 200 None
2026-03-30 09:08:19 [auto1.it] INFO: Scrape type for CP99007: 0
2026-03-30 09:08:19 [auto1.it] INFO: Found listing with ID: NF26556
2026-03-30 09:08:19 [auto1.it] INFO: Found listing with ID: NZ37386
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ37386%27 HTTP/1.1" 200 None
2026-03-30 09:08:19 [auto1.it] INFO: Scrape type for NZ37386: 2
2026-03-30 09:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 984681eb-5ab3-550f-aa59-ad913e7a7705 with identifier: NZ37386
2026-03-30 09:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984681eb-5ab3-550f-aa59-ad913e7a7705 with scrape type 2
2026-03-30 09:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 984681eb-5ab3-550f-aa59-ad913e7a7705 with scrape type 2
2026-03-30 09:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 984681eb-5ab3-550f-aa59-ad913e7a7705, identifier: NZ37386
2026-03-30 09:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 984681eb-5ab3-550f-aa59-ad913e7a7705 with identifier: NZ37386
2026-03-30 09:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 984681eb-5ab3-550f-aa59-ad913e7a7705 with identifier: NZ37386
2026-03-30 09:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 984681eb-5ab3-550f-aa59-ad913e7a7705 with identifier: NZ37386 to the API
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:16:06Z',
 'fuel_type': 'petrol',
 'id': '984681eb-5ab3-550f-aa59-ad913e7a7705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ37386',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 99934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-18',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Login',
 'transmission': 'manual',
 'trim': 'Login',
 'year': 2017}
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ37386%27 HTTP/1.1" 200 None
2026-03-30 09:08:19 [auto1.it] INFO: Saving data for NZ37386: {'auction_closing_time': 1774883766.0, 'created_time': 1774267479.596894, 'last_price_update_time': 1774861699.854275}
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NZ37386') HTTP/1.1" 204 0
2026-03-30 09:08:19 [auto1.it] INFO: Found listing with ID: LG11183
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG11183%27 HTTP/1.1" 200 None
2026-03-30 09:08:19 [auto1.it] INFO: Scrape type for LG11183: 2
2026-03-30 09:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e095d278-200d-5499-a81e-afaf1513cc4d with identifier: LG11183
2026-03-30 09:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e095d278-200d-5499-a81e-afaf1513cc4d with scrape type 2
2026-03-30 09:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e095d278-200d-5499-a81e-afaf1513cc4d with scrape type 2
2026-03-30 09:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e095d278-200d-5499-a81e-afaf1513cc4d, identifier: LG11183
2026-03-30 09:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e095d278-200d-5499-a81e-afaf1513cc4d with identifier: LG11183
2026-03-30 09:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e095d278-200d-5499-a81e-afaf1513cc4d with identifier: LG11183
2026-03-30 09:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e095d278-200d-5499-a81e-afaf1513cc4d with identifier: LG11183 to the API
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:02:07Z',
 'fuel_type': 'diesel',
 'id': 'e095d278-200d-5499-a81e-afaf1513cc4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG11183',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 27709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG11183%27 HTTP/1.1" 200 None
2026-03-30 09:08:20 [auto1.it] INFO: Saving data for LG11183: {'auction_closing_time': 1774882927.0, 'created_time': 1774645701.684057, 'last_price_update_time': 1774861700.455897}
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG11183') HTTP/1.1" 204 0
2026-03-30 09:08:20 [auto1.it] INFO: Channel: 24h | Page: 47 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:20 [auto1.it] INFO: Found listing with ID: LC07756
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC07756%27 HTTP/1.1" 200 None
2026-03-30 09:08:20 [auto1.it] INFO: Scrape type for LC07756: 0
2026-03-30 09:08:20 [auto1.it] INFO: Found listing with ID: RU03062
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU03062%27 HTTP/1.1" 200 None
2026-03-30 09:08:20 [auto1.it] INFO: Scrape type for RU03062: 2
2026-03-30 09:08:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07830c29-c813-5933-ae8e-d14c86fcdd51 with identifier: RU03062
2026-03-30 09:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07830c29-c813-5933-ae8e-d14c86fcdd51 with scrape type 2
2026-03-30 09:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07830c29-c813-5933-ae8e-d14c86fcdd51 with scrape type 2
2026-03-30 09:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 07830c29-c813-5933-ae8e-d14c86fcdd51, identifier: RU03062
2026-03-30 09:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 07830c29-c813-5933-ae8e-d14c86fcdd51 with identifier: RU03062
2026-03-30 09:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 07830c29-c813-5933-ae8e-d14c86fcdd51 with identifier: RU03062
2026-03-30 09:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 07830c29-c813-5933-ae8e-d14c86fcdd51 with identifier: RU03062 to the API
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:26:05Z',
 'fuel_type': 'diesel',
 'id': '07830c29-c813-5933-ae8e-d14c86fcdd51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU03062',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 63402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-27',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2020}
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU03062%27 HTTP/1.1" 200 None
2026-03-30 09:08:21 [auto1.it] INFO: Saving data for RU03062: {'auction_closing_time': 1774884365.0, 'created_time': 1773136055.613397, 'last_price_update_time': 1774861701.074859}
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RU03062') HTTP/1.1" 204 0
2026-03-30 09:08:21 [auto1.it] INFO: Found listing with ID: SN43721
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN43721%27 HTTP/1.1" 200 None
2026-03-30 09:08:21 [auto1.it] INFO: Scrape type for SN43721: 0
2026-03-30 09:08:21 [auto1.it] INFO: Found listing with ID: SA71650
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA71650%27 HTTP/1.1" 200 None
2026-03-30 09:08:21 [auto1.it] INFO: Scrape type for SA71650: 0
2026-03-30 09:08:21 [auto1.it] INFO: Found listing with ID: SH22107
2026-03-30 09:08:21 [auto1.it] INFO: Found listing with ID: DB18786
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB18786%27 HTTP/1.1" 200 None
2026-03-30 09:08:21 [auto1.it] INFO: Scrape type for DB18786: 2
2026-03-30 09:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61b7fb32-c722-57e5-81a2-1559c791bad2 with identifier: DB18786
2026-03-30 09:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61b7fb32-c722-57e5-81a2-1559c791bad2 with scrape type 2
2026-03-30 09:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61b7fb32-c722-57e5-81a2-1559c791bad2 with scrape type 2
2026-03-30 09:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 61b7fb32-c722-57e5-81a2-1559c791bad2, identifier: DB18786
2026-03-30 09:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 61b7fb32-c722-57e5-81a2-1559c791bad2 with identifier: DB18786
2026-03-30 09:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 61b7fb32-c722-57e5-81a2-1559c791bad2 with identifier: DB18786
2026-03-30 09:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 61b7fb32-c722-57e5-81a2-1559c791bad2 with identifier: DB18786 to the API
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:13Z',
 'fuel_type': 'diesel',
 'id': '61b7fb32-c722-57e5-81a2-1559c791bad2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB18786',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 108034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB18786%27 HTTP/1.1" 200 None
2026-03-30 09:08:21 [auto1.it] INFO: Saving data for DB18786: {'auction_closing_time': 1774885693.0, 'created_time': 1773305150.197253, 'last_price_update_time': 1774861701.556965}
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DB18786') HTTP/1.1" 204 0
2026-03-30 09:08:21 [auto1.it] INFO: Found listing with ID: VE23835
2026-03-30 09:08:21 [auto1.it] INFO: Found listing with ID: ZR59714
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR59714%27 HTTP/1.1" 200 None
2026-03-30 09:08:21 [auto1.it] INFO: Scrape type for ZR59714: 2
2026-03-30 09:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ac46a74-30cc-5b49-8eac-43cefbfd57e3 with identifier: ZR59714
2026-03-30 09:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ac46a74-30cc-5b49-8eac-43cefbfd57e3 with scrape type 2
2026-03-30 09:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ac46a74-30cc-5b49-8eac-43cefbfd57e3 with scrape type 2
2026-03-30 09:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7ac46a74-30cc-5b49-8eac-43cefbfd57e3, identifier: ZR59714
2026-03-30 09:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7ac46a74-30cc-5b49-8eac-43cefbfd57e3 with identifier: ZR59714
2026-03-30 09:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7ac46a74-30cc-5b49-8eac-43cefbfd57e3 with identifier: ZR59714
2026-03-30 09:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7ac46a74-30cc-5b49-8eac-43cefbfd57e3 with identifier: ZR59714 to the API
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:30:33Z',
 'fuel_type': 'hybrid',
 'id': '7ac46a74-30cc-5b49-8eac-43cefbfd57e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR59714',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 96299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-29',
 'seller_name': None,
 'title': 'BMW 5er 530e Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2018}
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR59714%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [auto1.it] INFO: Saving data for ZR59714: {'auction_closing_time': 1774884633.0, 'created_time': 1774083634.660898, 'last_price_update_time': 1774861702.089381}
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZR59714') HTTP/1.1" 204 0
2026-03-30 09:08:22 [auto1.it] INFO: Found listing with ID: VC26054
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC26054%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [auto1.it] INFO: Scrape type for VC26054: 0
2026-03-30 09:08:22 [auto1.it] INFO: Found listing with ID: GV78973
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV78973%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [auto1.it] INFO: Scrape type for GV78973: 2
2026-03-30 09:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 257abedb-3d08-5c40-b29f-70378261230e with identifier: GV78973
2026-03-30 09:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 257abedb-3d08-5c40-b29f-70378261230e with scrape type 2
2026-03-30 09:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 257abedb-3d08-5c40-b29f-70378261230e with scrape type 2
2026-03-30 09:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 257abedb-3d08-5c40-b29f-70378261230e, identifier: GV78973
2026-03-30 09:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 257abedb-3d08-5c40-b29f-70378261230e with identifier: GV78973
2026-03-30 09:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 257abedb-3d08-5c40-b29f-70378261230e with identifier: GV78973
2026-03-30 09:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 257abedb-3d08-5c40-b29f-70378261230e with identifier: GV78973 to the API
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:38:38Z',
 'fuel_type': 'diesel',
 'id': '257abedb-3d08-5c40-b29f-70378261230e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV78973',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 118945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTD Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2017}
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV78973%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [auto1.it] INFO: Saving data for GV78973: {'auction_closing_time': 1774885118.0, 'created_time': 1774558870.716489, 'last_price_update_time': 1774861702.549208}
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GV78973') HTTP/1.1" 204 0
2026-03-30 09:08:22 [auto1.it] INFO: Found listing with ID: US69373
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US69373%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [auto1.it] INFO: Scrape type for US69373: 2
2026-03-30 09:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e6f427e-f76b-58cd-a8b3-6a6a7f78ae3f with identifier: US69373
2026-03-30 09:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e6f427e-f76b-58cd-a8b3-6a6a7f78ae3f with scrape type 2
2026-03-30 09:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e6f427e-f76b-58cd-a8b3-6a6a7f78ae3f with scrape type 2
2026-03-30 09:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0e6f427e-f76b-58cd-a8b3-6a6a7f78ae3f, identifier: US69373
2026-03-30 09:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0e6f427e-f76b-58cd-a8b3-6a6a7f78ae3f with identifier: US69373
2026-03-30 09:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0e6f427e-f76b-58cd-a8b3-6a6a7f78ae3f with identifier: US69373
2026-03-30 09:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0e6f427e-f76b-58cd-a8b3-6a6a7f78ae3f with identifier: US69373 to the API
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:33:19Z',
 'fuel_type': 'petrol',
 'id': '0e6f427e-f76b-58cd-a8b3-6a6a7f78ae3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US69373',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 35879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-14',
 'seller_name': None,
 'title': 'Fiat 500 1.4 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2011}
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US69373%27 HTTP/1.1" 200 None
2026-03-30 09:08:23 [auto1.it] INFO: Saving data for US69373: {'auction_closing_time': 1774884799.0, 'created_time': 1773759785.889286, 'last_price_update_time': 1774861703.010228}
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='US69373') HTTP/1.1" 204 0
2026-03-30 09:08:23 [auto1.it] INFO: Found listing with ID: RZ15516
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ15516%27 HTTP/1.1" 200 None
2026-03-30 09:08:23 [auto1.it] INFO: Scrape type for RZ15516: 0
2026-03-30 09:08:23 [auto1.it] INFO: Found listing with ID: UZ55357
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ55357%27 HTTP/1.1" 200 None
2026-03-30 09:08:23 [auto1.it] INFO: Scrape type for UZ55357: 2
2026-03-30 09:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aae14d7e-c18e-5ae6-b895-18fac22530f0 with identifier: UZ55357
2026-03-30 09:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aae14d7e-c18e-5ae6-b895-18fac22530f0 with scrape type 2
2026-03-30 09:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aae14d7e-c18e-5ae6-b895-18fac22530f0 with scrape type 2
2026-03-30 09:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aae14d7e-c18e-5ae6-b895-18fac22530f0, identifier: UZ55357
2026-03-30 09:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aae14d7e-c18e-5ae6-b895-18fac22530f0 with identifier: UZ55357
2026-03-30 09:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aae14d7e-c18e-5ae6-b895-18fac22530f0 with identifier: UZ55357
2026-03-30 09:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aae14d7e-c18e-5ae6-b895-18fac22530f0 with identifier: UZ55357 to the API
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:58:46Z',
 'fuel_type': 'diesel',
 'id': 'aae14d7e-c18e-5ae6-b895-18fac22530f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ55357',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 158712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-22',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi Comfort AWD',
 'transmission': 'manual',
 'trim': 'Comfort AWD',
 'year': 2012}
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ55357%27 HTTP/1.1" 200 None
2026-03-30 09:08:23 [auto1.it] INFO: Saving data for UZ55357: {'auction_closing_time': 1774886326.0, 'created_time': 1774645647.7773, 'last_price_update_time': 1774861703.864321}
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UZ55357') HTTP/1.1" 204 0
2026-03-30 09:08:23 [auto1.it] INFO: Found listing with ID: EJ70164
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ70164%27 HTTP/1.1" 200 None
2026-03-30 09:08:23 [auto1.it] INFO: Scrape type for EJ70164: 0
2026-03-30 09:08:23 [auto1.it] INFO: Found listing with ID: DW16027
2026-03-30 09:08:23 [auto1.it] INFO: Found listing with ID: EZ15489
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ15489%27 HTTP/1.1" 200 None
2026-03-30 09:08:23 [auto1.it] INFO: Scrape type for EZ15489: 0
2026-03-30 09:08:23 [auto1.it] INFO: Found listing with ID: XC90090
2026-03-30 09:08:23 [auto1.it] INFO: Found listing with ID: PZ08956
2026-03-30 09:08:23 [auto1.it] INFO: Found listing with ID: LB78915
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB78915%27 HTTP/1.1" 200 None
2026-03-30 09:08:23 [auto1.it] INFO: Scrape type for LB78915: 0
2026-03-30 09:08:23 [auto1.it] INFO: Found listing with ID: BV29552
2026-03-30 09:08:23 [auto1.it] INFO: Found listing with ID: TK94629
2026-03-30 09:08:23 [auto1.it] INFO: Found listing with ID: XT45099
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT45099%27 HTTP/1.1" 200 None
2026-03-30 09:08:23 [auto1.it] INFO: Scrape type for XT45099: 0
2026-03-30 09:08:23 [auto1.it] INFO: Found listing with ID: DX23883
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX23883%27 HTTP/1.1" 200 None
2026-03-30 09:08:23 [auto1.it] INFO: Scrape type for DX23883: 0
2026-03-30 09:08:23 [auto1.it] INFO: Found listing with ID: FM13591
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM13591%27 HTTP/1.1" 200 None
2026-03-30 09:08:24 [auto1.it] INFO: Scrape type for FM13591: 0
2026-03-30 09:08:24 [auto1.it] INFO: Found listing with ID: VS11522
2026-03-30 09:08:24 [auto1.it] INFO: Found listing with ID: YA27066
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA27066%27 HTTP/1.1" 200 None
2026-03-30 09:08:24 [auto1.it] INFO: Scrape type for YA27066: 0
2026-03-30 09:08:24 [auto1.it] INFO: Found listing with ID: YC82026
2026-03-30 09:08:24 [auto1.it] INFO: Found listing with ID: AM02692
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM02692%27 HTTP/1.1" 200 None
2026-03-30 09:08:24 [auto1.it] INFO: Scrape type for AM02692: 2
2026-03-30 09:08:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98c5cac-afa7-5e70-a8a5-de8c3abbf94e with identifier: AM02692
2026-03-30 09:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98c5cac-afa7-5e70-a8a5-de8c3abbf94e with scrape type 2
2026-03-30 09:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b98c5cac-afa7-5e70-a8a5-de8c3abbf94e with scrape type 2
2026-03-30 09:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b98c5cac-afa7-5e70-a8a5-de8c3abbf94e, identifier: AM02692
2026-03-30 09:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b98c5cac-afa7-5e70-a8a5-de8c3abbf94e with identifier: AM02692
2026-03-30 09:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b98c5cac-afa7-5e70-a8a5-de8c3abbf94e with identifier: AM02692
2026-03-30 09:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b98c5cac-afa7-5e70-a8a5-de8c3abbf94e with identifier: AM02692 to the API
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:53:53Z',
 'fuel_type': 'diesel',
 'id': 'b98c5cac-afa7-5e70-a8a5-de8c3abbf94e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM02692',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 142850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-13',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Shooting Brake Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2016}
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM02692%27 HTTP/1.1" 200 None
2026-03-30 09:08:24 [auto1.it] INFO: Saving data for AM02692: {'auction_closing_time': 1774886033.0, 'created_time': 1774645372.185528, 'last_price_update_time': 1774861704.438826}
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AM02692') HTTP/1.1" 204 0
2026-03-30 09:08:24 [auto1.it] INFO: Found listing with ID: BF81880
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF81880%27 HTTP/1.1" 200 None
2026-03-30 09:08:24 [auto1.it] INFO: Scrape type for BF81880: 0
2026-03-30 09:08:24 [auto1.it] INFO: Found listing with ID: MU47199
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU47199%27 HTTP/1.1" 200 None
2026-03-30 09:08:24 [auto1.it] INFO: Scrape type for MU47199: 2
2026-03-30 09:08:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74eb655c-0bae-5b08-8bd3-860e83d4b6c0 with identifier: MU47199
2026-03-30 09:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74eb655c-0bae-5b08-8bd3-860e83d4b6c0 with scrape type 2
2026-03-30 09:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74eb655c-0bae-5b08-8bd3-860e83d4b6c0 with scrape type 2
2026-03-30 09:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 74eb655c-0bae-5b08-8bd3-860e83d4b6c0, identifier: MU47199
2026-03-30 09:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 74eb655c-0bae-5b08-8bd3-860e83d4b6c0 with identifier: MU47199
2026-03-30 09:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 74eb655c-0bae-5b08-8bd3-860e83d4b6c0 with identifier: MU47199
2026-03-30 09:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 74eb655c-0bae-5b08-8bd3-860e83d4b6c0 with identifier: MU47199 to the API
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:35:06Z',
 'fuel_type': 'petrol',
 'id': '74eb655c-0bae-5b08-8bd3-860e83d4b6c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU47199',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 186925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-23',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU47199%27 HTTP/1.1" 200 None
2026-03-30 09:08:25 [auto1.it] INFO: Saving data for MU47199: {'auction_closing_time': 1774884906.0, 'created_time': 1774558904.673582, 'last_price_update_time': 1774861705.042734}
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MU47199') HTTP/1.1" 204 0
2026-03-30 09:08:25 [auto1.it] INFO: Found listing with ID: SL34558
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL34558%27 HTTP/1.1" 200 None
2026-03-30 09:08:25 [auto1.it] INFO: Scrape type for SL34558: 2
2026-03-30 09:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 501e41ed-979c-5bcc-81cd-0f7ed999d296 with identifier: SL34558
2026-03-30 09:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 501e41ed-979c-5bcc-81cd-0f7ed999d296 with scrape type 2
2026-03-30 09:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 501e41ed-979c-5bcc-81cd-0f7ed999d296 with scrape type 2
2026-03-30 09:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 501e41ed-979c-5bcc-81cd-0f7ed999d296, identifier: SL34558
2026-03-30 09:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 501e41ed-979c-5bcc-81cd-0f7ed999d296 with identifier: SL34558
2026-03-30 09:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 501e41ed-979c-5bcc-81cd-0f7ed999d296 with identifier: SL34558
2026-03-30 09:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 501e41ed-979c-5bcc-81cd-0f7ed999d296 with identifier: SL34558 to the API
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:28:14Z',
 'fuel_type': 'diesel',
 'id': '501e41ed-979c-5bcc-81cd-0f7ed999d296',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL34558',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 220095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-04',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL34558%27 HTTP/1.1" 200 None
2026-03-30 09:08:25 [auto1.it] INFO: Saving data for SL34558: {'auction_closing_time': 1774884494.0, 'created_time': 1773738230.769253, 'last_price_update_time': 1774861705.466462}
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SL34558') HTTP/1.1" 204 0
2026-03-30 09:08:25 [auto1.it] INFO: Found listing with ID: RJ45303
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ45303%27 HTTP/1.1" 200 None
2026-03-30 09:08:25 [auto1.it] INFO: Scrape type for RJ45303: 0
2026-03-30 09:08:25 [auto1.it] INFO: Found listing with ID: NP01679
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP01679%27 HTTP/1.1" 200 None
2026-03-30 09:08:25 [auto1.it] INFO: Scrape type for NP01679: 0
2026-03-30 09:08:25 [auto1.it] INFO: Found listing with ID: ZJ24732
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ24732%27 HTTP/1.1" 200 None
2026-03-30 09:08:25 [auto1.it] INFO: Scrape type for ZJ24732: 2
2026-03-30 09:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d44794e-fdf0-5d4f-a41a-40e52ef4cd30 with identifier: ZJ24732
2026-03-30 09:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d44794e-fdf0-5d4f-a41a-40e52ef4cd30 with scrape type 2
2026-03-30 09:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d44794e-fdf0-5d4f-a41a-40e52ef4cd30 with scrape type 2
2026-03-30 09:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7d44794e-fdf0-5d4f-a41a-40e52ef4cd30, identifier: ZJ24732
2026-03-30 09:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7d44794e-fdf0-5d4f-a41a-40e52ef4cd30 with identifier: ZJ24732
2026-03-30 09:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7d44794e-fdf0-5d4f-a41a-40e52ef4cd30 with identifier: ZJ24732
2026-03-30 09:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7d44794e-fdf0-5d4f-a41a-40e52ef4cd30 with identifier: ZJ24732 to the API
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:12:27Z',
 'fuel_type': 'diesel',
 'id': '7d44794e-fdf0-5d4f-a41a-40e52ef4cd30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ24732',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 104936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-25',
 'seller_name': None,
 'title': 'Fiat 500L 1.6 JTDM Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2014}
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ24732%27 HTTP/1.1" 200 None
2026-03-30 09:08:25 [auto1.it] INFO: Saving data for ZJ24732: {'auction_closing_time': 1774883547.0, 'created_time': 1774558881.652723, 'last_price_update_time': 1774861705.989268}
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZJ24732') HTTP/1.1" 204 0
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: FY53013
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: LA76603
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: AY40178
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: UK76860
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: RD96225
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD96225%27 HTTP/1.1" 200 None
2026-03-30 09:08:26 [auto1.it] INFO: Scrape type for RD96225: 2
2026-03-30 09:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde14d93-876a-57fc-a664-3a49b4abab03 with identifier: RD96225
2026-03-30 09:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde14d93-876a-57fc-a664-3a49b4abab03 with scrape type 2
2026-03-30 09:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cde14d93-876a-57fc-a664-3a49b4abab03 with scrape type 2
2026-03-30 09:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cde14d93-876a-57fc-a664-3a49b4abab03, identifier: RD96225
2026-03-30 09:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cde14d93-876a-57fc-a664-3a49b4abab03 with identifier: RD96225
2026-03-30 09:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cde14d93-876a-57fc-a664-3a49b4abab03 with identifier: RD96225
2026-03-30 09:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cde14d93-876a-57fc-a664-3a49b4abab03 with identifier: RD96225 to the API
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:14:54Z',
 'fuel_type': 'diesel',
 'id': 'cde14d93-876a-57fc-a664-3a49b4abab03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD96225',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 363518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-06',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2011}
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD96225%27 HTTP/1.1" 200 None
2026-03-30 09:08:26 [auto1.it] INFO: Saving data for RD96225: {'auction_closing_time': 1774883694.0, 'created_time': 1773749191.966224, 'last_price_update_time': 1774861706.465205}
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RD96225') HTTP/1.1" 204 0
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: ES67961
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES67961%27 HTTP/1.1" 200 None
2026-03-30 09:08:26 [auto1.it] INFO: Scrape type for ES67961: 0
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: WH06276
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: JY18899
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY18899%27 HTTP/1.1" 200 None
2026-03-30 09:08:26 [auto1.it] INFO: Scrape type for JY18899: 2
2026-03-30 09:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c92e31b-fb0a-51d7-a771-f0c4b134101b with identifier: JY18899
2026-03-30 09:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c92e31b-fb0a-51d7-a771-f0c4b134101b with scrape type 2
2026-03-30 09:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c92e31b-fb0a-51d7-a771-f0c4b134101b with scrape type 2
2026-03-30 09:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c92e31b-fb0a-51d7-a771-f0c4b134101b, identifier: JY18899
2026-03-30 09:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c92e31b-fb0a-51d7-a771-f0c4b134101b with identifier: JY18899
2026-03-30 09:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c92e31b-fb0a-51d7-a771-f0c4b134101b with identifier: JY18899
2026-03-30 09:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c92e31b-fb0a-51d7-a771-f0c4b134101b with identifier: JY18899 to the API
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:29:20Z',
 'fuel_type': 'diesel',
 'id': '5c92e31b-fb0a-51d7-a771-f0c4b134101b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY18899',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 237446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-06',
 'seller_name': None,
 'title': 'Opel Meriva 1.7 CDTI Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2012}
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY18899%27 HTTP/1.1" 200 None
2026-03-30 09:08:27 [auto1.it] INFO: Saving data for JY18899: {'auction_closing_time': 1774884560.0, 'created_time': 1772573677.40764, 'last_price_update_time': 1774861707.09667}
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JY18899') HTTP/1.1" 204 0
2026-03-30 09:08:27 [auto1.it] INFO: Channel: 24h | Page: 48 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:27 [auto1.it] INFO: Found listing with ID: AH91466
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH91466%27 HTTP/1.1" 200 None
2026-03-30 09:08:27 [auto1.it] INFO: Scrape type for AH91466: 2
2026-03-30 09:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e867f44d-315e-5e25-88d7-49aa58ae0576 with identifier: AH91466
2026-03-30 09:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e867f44d-315e-5e25-88d7-49aa58ae0576 with scrape type 2
2026-03-30 09:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e867f44d-315e-5e25-88d7-49aa58ae0576 with scrape type 2
2026-03-30 09:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e867f44d-315e-5e25-88d7-49aa58ae0576, identifier: AH91466
2026-03-30 09:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e867f44d-315e-5e25-88d7-49aa58ae0576 with identifier: AH91466
2026-03-30 09:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e867f44d-315e-5e25-88d7-49aa58ae0576 with identifier: AH91466
2026-03-30 09:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e867f44d-315e-5e25-88d7-49aa58ae0576 with identifier: AH91466 to the API
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:04:27Z',
 'fuel_type': 'diesel',
 'id': 'e867f44d-315e-5e25-88d7-49aa58ae0576',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH91466',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 213683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Executive BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Executive BlueMotion Tech',
 'year': 2017}
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH91466%27 HTTP/1.1" 200 None
2026-03-30 09:08:27 [auto1.it] INFO: Saving data for AH91466: {'auction_closing_time': 1774883067.0, 'created_time': 1774559021.230962, 'last_price_update_time': 1774861707.556078}
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AH91466') HTTP/1.1" 204 0
2026-03-30 09:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:27 [auto1.it] INFO: Found listing with ID: CH37521
2026-03-30 09:08:27 [auto1.it] INFO: Found listing with ID: UW72001
2026-03-30 09:08:27 [auto1.it] INFO: Found listing with ID: SN82896
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN82896%27 HTTP/1.1" 200 None
2026-03-30 09:08:27 [auto1.it] INFO: Scrape type for SN82896: 2
2026-03-30 09:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb8cb517-bf2d-5653-b6c6-508665257d7a with identifier: SN82896
2026-03-30 09:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb8cb517-bf2d-5653-b6c6-508665257d7a with scrape type 2
2026-03-30 09:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb8cb517-bf2d-5653-b6c6-508665257d7a with scrape type 2
2026-03-30 09:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eb8cb517-bf2d-5653-b6c6-508665257d7a, identifier: SN82896
2026-03-30 09:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eb8cb517-bf2d-5653-b6c6-508665257d7a with identifier: SN82896
2026-03-30 09:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eb8cb517-bf2d-5653-b6c6-508665257d7a with identifier: SN82896
2026-03-30 09:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eb8cb517-bf2d-5653-b6c6-508665257d7a with identifier: SN82896 to the API
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T16:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eb8cb517-bf2d-5653-b6c6-508665257d7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN82896',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 83672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-22',
 'seller_name': None,
 'title': 'BMW 1er 118d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN82896%27 HTTP/1.1" 200 None
2026-03-30 09:08:28 [auto1.it] INFO: Saving data for SN82896: {'auction_closing_time': 1774886400.0, 'created_time': 1774559117.310624, 'last_price_update_time': 1774861708.026655}
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SN82896') HTTP/1.1" 204 0
2026-03-30 09:08:28 [auto1.it] INFO: Found listing with ID: UM78803
2026-03-30 09:08:28 [auto1.it] INFO: Found listing with ID: KR43222
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR43222%27 HTTP/1.1" 200 None
2026-03-30 09:08:28 [auto1.it] INFO: Scrape type for KR43222: 0
2026-03-30 09:08:28 [auto1.it] INFO: Found listing with ID: LV68988
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV68988%27 HTTP/1.1" 200 None
2026-03-30 09:08:28 [auto1.it] INFO: Scrape type for LV68988: 2
2026-03-30 09:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc5c81b4-8038-5e86-9660-3c1a4a94f24d with identifier: LV68988
2026-03-30 09:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc5c81b4-8038-5e86-9660-3c1a4a94f24d with scrape type 2
2026-03-30 09:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc5c81b4-8038-5e86-9660-3c1a4a94f24d with scrape type 2
2026-03-30 09:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fc5c81b4-8038-5e86-9660-3c1a4a94f24d, identifier: LV68988
2026-03-30 09:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fc5c81b4-8038-5e86-9660-3c1a4a94f24d with identifier: LV68988
2026-03-30 09:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fc5c81b4-8038-5e86-9660-3c1a4a94f24d with identifier: LV68988
2026-03-30 09:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fc5c81b4-8038-5e86-9660-3c1a4a94f24d with identifier: LV68988 to the API
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:42:35Z',
 'fuel_type': 'petrol',
 'id': 'fc5c81b4-8038-5e86-9660-3c1a4a94f24d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV68988',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 78751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-12',
 'seller_name': None,
 'title': 'Renault Kadjar 1.3 TCe Sport Edition',
 'transmission': 'manual',
 'trim': 'Sport Edition',
 'year': 2019}
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV68988%27 HTTP/1.1" 200 None
2026-03-30 09:08:28 [auto1.it] INFO: Saving data for LV68988: {'auction_closing_time': 1774885355.0, 'created_time': 1774342919.389466, 'last_price_update_time': 1774861708.606268}
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LV68988') HTTP/1.1" 204 0
2026-03-30 09:08:28 [auto1.it] INFO: Found listing with ID: BR67394
2026-03-30 09:08:28 [auto1.it] INFO: Found listing with ID: CY31858
2026-03-30 09:08:28 [auto1.it] INFO: Found listing with ID: RD78006
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD78006%27 HTTP/1.1" 200 None
2026-03-30 09:08:28 [auto1.it] INFO: Scrape type for RD78006: 2
2026-03-30 09:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29bd2d5a-1b67-5f27-843f-80fc783e5ff5 with identifier: RD78006
2026-03-30 09:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29bd2d5a-1b67-5f27-843f-80fc783e5ff5 with scrape type 2
2026-03-30 09:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29bd2d5a-1b67-5f27-843f-80fc783e5ff5 with scrape type 2
2026-03-30 09:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 29bd2d5a-1b67-5f27-843f-80fc783e5ff5, identifier: RD78006
2026-03-30 09:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 29bd2d5a-1b67-5f27-843f-80fc783e5ff5 with identifier: RD78006
2026-03-30 09:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 29bd2d5a-1b67-5f27-843f-80fc783e5ff5 with identifier: RD78006
2026-03-30 09:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 29bd2d5a-1b67-5f27-843f-80fc783e5ff5 with identifier: RD78006 to the API
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:42:50Z',
 'fuel_type': 'diesel',
 'id': '29bd2d5a-1b67-5f27-843f-80fc783e5ff5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD78006',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 57155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-28',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
 'transmission': 'automatic',
 'trim': 'Overland',
 'year': 2020}
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD78006%27 HTTP/1.1" 200 None
2026-03-30 09:08:29 [auto1.it] INFO: Saving data for RD78006: {'auction_closing_time': 1774885370.0, 'created_time': 1774645698.936117, 'last_price_update_time': 1774861709.019568}
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RD78006') HTTP/1.1" 204 0
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: CD01213
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: SN26450
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: MT71865
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT71865%27 HTTP/1.1" 200 None
2026-03-30 09:08:29 [auto1.it] INFO: Scrape type for MT71865: 2
2026-03-30 09:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be561692-0ede-56eb-901b-0e4aefa48d6e with identifier: MT71865
2026-03-30 09:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be561692-0ede-56eb-901b-0e4aefa48d6e with scrape type 2
2026-03-30 09:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be561692-0ede-56eb-901b-0e4aefa48d6e with scrape type 2
2026-03-30 09:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be561692-0ede-56eb-901b-0e4aefa48d6e, identifier: MT71865
2026-03-30 09:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be561692-0ede-56eb-901b-0e4aefa48d6e with identifier: MT71865
2026-03-30 09:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be561692-0ede-56eb-901b-0e4aefa48d6e with identifier: MT71865
2026-03-30 09:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be561692-0ede-56eb-901b-0e4aefa48d6e with identifier: MT71865 to the API
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:05Z',
 'fuel_type': 'diesel',
 'id': 'be561692-0ede-56eb-901b-0e4aefa48d6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT71865',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 223052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-04',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI quattro Ambition',
 'transmission': 'manual',
 'trim': 'quattro Ambition',
 'year': 2014}
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT71865%27 HTTP/1.1" 200 None
2026-03-30 09:08:29 [auto1.it] INFO: Saving data for MT71865: {'auction_closing_time': 1774883465.0, 'created_time': 1774342964.93512, 'last_price_update_time': 1774861709.552893}
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MT71865') HTTP/1.1" 204 0
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: CP76510
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: YX83263
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX83263%27 HTTP/1.1" 200 None
2026-03-30 09:08:29 [auto1.it] INFO: Scrape type for YX83263: 0
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: PZ52577
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: VS54724
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS54724%27 HTTP/1.1" 200 None
2026-03-30 09:08:29 [auto1.it] INFO: Scrape type for VS54724: 0
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: KH25019
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH25019%27 HTTP/1.1" 200 None
2026-03-30 09:08:29 [auto1.it] INFO: Scrape type for KH25019: 0
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: PN56075
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN56075%27 HTTP/1.1" 200 None
2026-03-30 09:08:29 [auto1.it] INFO: Scrape type for PN56075: 0
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: HZ92978
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ92978%27 HTTP/1.1" 200 None
2026-03-30 09:08:29 [auto1.it] INFO: Scrape type for HZ92978: 0
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: EC20535
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC20535%27 HTTP/1.1" 200 None
2026-03-30 09:08:29 [auto1.it] INFO: Scrape type for EC20535: 2
2026-03-30 09:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c10095b-e967-5394-b601-bb458e3e1fe8 with identifier: EC20535
2026-03-30 09:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c10095b-e967-5394-b601-bb458e3e1fe8 with scrape type 2
2026-03-30 09:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c10095b-e967-5394-b601-bb458e3e1fe8 with scrape type 2
2026-03-30 09:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c10095b-e967-5394-b601-bb458e3e1fe8, identifier: EC20535
2026-03-30 09:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c10095b-e967-5394-b601-bb458e3e1fe8 with identifier: EC20535
2026-03-30 09:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c10095b-e967-5394-b601-bb458e3e1fe8 with identifier: EC20535
2026-03-30 09:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c10095b-e967-5394-b601-bb458e3e1fe8 with identifier: EC20535 to the API
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:25:08Z',
 'fuel_type': 'diesel',
 'id': '6c10095b-e967-5394-b601-bb458e3e1fe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC20535',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 322304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-11',
 'seller_name': None,
 'title': 'BMW X3 3.0d',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC20535%27 HTTP/1.1" 200 None
2026-03-30 09:08:30 [auto1.it] INFO: Saving data for EC20535: {'auction_closing_time': 1774884308.0, 'created_time': 1774558964.931766, 'last_price_update_time': 1774861710.094763}
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC20535') HTTP/1.1" 204 0
2026-03-30 09:08:30 [auto1.it] INFO: Found listing with ID: VX84045
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX84045%27 HTTP/1.1" 200 None
2026-03-30 09:08:30 [auto1.it] INFO: Scrape type for VX84045: 2
2026-03-30 09:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96abc4a4-0c96-5530-abf1-bcfc6276b39a with identifier: VX84045
2026-03-30 09:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96abc4a4-0c96-5530-abf1-bcfc6276b39a with scrape type 2
2026-03-30 09:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96abc4a4-0c96-5530-abf1-bcfc6276b39a with scrape type 2
2026-03-30 09:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 96abc4a4-0c96-5530-abf1-bcfc6276b39a, identifier: VX84045
2026-03-30 09:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 96abc4a4-0c96-5530-abf1-bcfc6276b39a with identifier: VX84045
2026-03-30 09:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 96abc4a4-0c96-5530-abf1-bcfc6276b39a with identifier: VX84045
2026-03-30 09:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 96abc4a4-0c96-5530-abf1-bcfc6276b39a with identifier: VX84045 to the API
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:26Z',
 'fuel_type': 'diesel',
 'id': '96abc4a4-0c96-5530-abf1-bcfc6276b39a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX84045',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 141984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-25',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Evolve',
 'transmission': 'manual',
 'trim': 'Evolve',
 'year': 2014}
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX84045%27 HTTP/1.1" 200 None
2026-03-30 09:08:30 [auto1.it] INFO: Saving data for VX84045: {'auction_closing_time': 1774885706.0, 'created_time': 1773868245.38926, 'last_price_update_time': 1774861710.590964}
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VX84045') HTTP/1.1" 204 0
2026-03-30 09:08:30 [auto1.it] INFO: Found listing with ID: YJ87795
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ87795%27 HTTP/1.1" 200 None
2026-03-30 09:08:30 [auto1.it] INFO: Scrape type for YJ87795: 2
2026-03-30 09:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8b998ee-bdc6-5fde-808b-311fb9e6731a with identifier: YJ87795
2026-03-30 09:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b998ee-bdc6-5fde-808b-311fb9e6731a with scrape type 2
2026-03-30 09:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8b998ee-bdc6-5fde-808b-311fb9e6731a with scrape type 2
2026-03-30 09:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a8b998ee-bdc6-5fde-808b-311fb9e6731a, identifier: YJ87795
2026-03-30 09:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a8b998ee-bdc6-5fde-808b-311fb9e6731a with identifier: YJ87795
2026-03-30 09:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a8b998ee-bdc6-5fde-808b-311fb9e6731a with identifier: YJ87795
2026-03-30 09:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a8b998ee-bdc6-5fde-808b-311fb9e6731a with identifier: YJ87795 to the API
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:45:17Z',
 'fuel_type': 'diesel',
 'id': 'a8b998ee-bdc6-5fde-808b-311fb9e6731a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ87795',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 191256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seller_name': None,
 'title': 'Jeep Compass 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2019}
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ87795%27 HTTP/1.1" 200 None
2026-03-30 09:08:31 [auto1.it] INFO: Saving data for YJ87795: {'auction_closing_time': 1774885517.0, 'created_time': 1774645474.487622, 'last_price_update_time': 1774861711.019868}
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YJ87795') HTTP/1.1" 204 0
2026-03-30 09:08:31 [auto1.it] INFO: Found listing with ID: JT68367
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT68367%27 HTTP/1.1" 200 None
2026-03-30 09:08:31 [auto1.it] INFO: Scrape type for JT68367: 0
2026-03-30 09:08:31 [auto1.it] INFO: Found listing with ID: XZ26785
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ26785%27 HTTP/1.1" 200 None
2026-03-30 09:08:31 [auto1.it] INFO: Scrape type for XZ26785: 2
2026-03-30 09:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6893a9bd-e646-5a1d-af64-b1dec6a55f77 with identifier: XZ26785
2026-03-30 09:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6893a9bd-e646-5a1d-af64-b1dec6a55f77 with scrape type 2
2026-03-30 09:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6893a9bd-e646-5a1d-af64-b1dec6a55f77 with scrape type 2
2026-03-30 09:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6893a9bd-e646-5a1d-af64-b1dec6a55f77, identifier: XZ26785
2026-03-30 09:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6893a9bd-e646-5a1d-af64-b1dec6a55f77 with identifier: XZ26785
2026-03-30 09:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6893a9bd-e646-5a1d-af64-b1dec6a55f77 with identifier: XZ26785
2026-03-30 09:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6893a9bd-e646-5a1d-af64-b1dec6a55f77 with identifier: XZ26785 to the API
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:16Z',
 'fuel_type': 'diesel',
 'id': '6893a9bd-e646-5a1d-af64-b1dec6a55f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ26785',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 58882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-08',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Momentum Core 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Core 2WD',
 'year': 2020}
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ26785%27 HTTP/1.1" 200 None
2026-03-30 09:08:31 [auto1.it] INFO: Saving data for XZ26785: {'auction_closing_time': 1774886296.0, 'created_time': 1774645365.851386, 'last_price_update_time': 1774861711.78336}
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XZ26785') HTTP/1.1" 204 0
2026-03-30 09:08:31 [auto1.it] INFO: Found listing with ID: YZ06369
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ06369%27 HTTP/1.1" 200 None
2026-03-30 09:08:31 [auto1.it] INFO: Scrape type for YZ06369: 0
2026-03-30 09:08:31 [auto1.it] INFO: Found listing with ID: ZS94509
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS94509%27 HTTP/1.1" 200 None
2026-03-30 09:08:31 [auto1.it] INFO: Scrape type for ZS94509: 0
2026-03-30 09:08:31 [auto1.it] INFO: Found listing with ID: CV42265
2026-03-30 09:08:31 [auto1.it] INFO: Found listing with ID: SM34278
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM34278%27 HTTP/1.1" 200 None
2026-03-30 09:08:31 [auto1.it] INFO: Scrape type for SM34278: 0
2026-03-30 09:08:31 [auto1.it] INFO: Found listing with ID: RG49415
2026-03-30 09:08:31 [auto1.it] INFO: Found listing with ID: EB44721
2026-03-30 09:08:31 [auto1.it] INFO: Found listing with ID: LM72883
2026-03-30 09:08:31 [auto1.it] INFO: Found listing with ID: JC85025
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC85025%27 HTTP/1.1" 200 None
2026-03-30 09:08:31 [auto1.it] INFO: Scrape type for JC85025: 2
2026-03-30 09:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b537c67a-425a-5fdd-acd4-4a8a496d427f with identifier: JC85025
2026-03-30 09:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b537c67a-425a-5fdd-acd4-4a8a496d427f with scrape type 2
2026-03-30 09:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b537c67a-425a-5fdd-acd4-4a8a496d427f with scrape type 2
2026-03-30 09:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b537c67a-425a-5fdd-acd4-4a8a496d427f, identifier: JC85025
2026-03-30 09:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b537c67a-425a-5fdd-acd4-4a8a496d427f with identifier: JC85025
2026-03-30 09:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b537c67a-425a-5fdd-acd4-4a8a496d427f with identifier: JC85025
2026-03-30 09:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b537c67a-425a-5fdd-acd4-4a8a496d427f with identifier: JC85025 to the API
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:22:20Z',
 'fuel_type': 'diesel',
 'id': 'b537c67a-425a-5fdd-acd4-4a8a496d427f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC85025',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 182739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-25',
 'seller_name': None,
 'title': 'Renault Talisman 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2018}
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC85025%27 HTTP/1.1" 200 None
2026-03-30 09:08:32 [auto1.it] INFO: Saving data for JC85025: {'auction_closing_time': 1774884140.0, 'created_time': 1774645630.244639, 'last_price_update_time': 1774861712.236409}
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JC85025') HTTP/1.1" 204 0
2026-03-30 09:08:32 [auto1.it] INFO: Found listing with ID: FC91970
2026-03-30 09:08:32 [auto1.it] INFO: Found listing with ID: PR30387
2026-03-30 09:08:32 [auto1.it] INFO: Found listing with ID: NN68396
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN68396%27 HTTP/1.1" 200 None
2026-03-30 09:08:32 [auto1.it] INFO: Scrape type for NN68396: 0
2026-03-30 09:08:32 [auto1.it] INFO: Found listing with ID: BS72965
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS72965%27 HTTP/1.1" 200 None
2026-03-30 09:08:32 [auto1.it] INFO: Scrape type for BS72965: 0
2026-03-30 09:08:32 [auto1.it] INFO: Found listing with ID: BE28605
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE28605%27 HTTP/1.1" 200 None
2026-03-30 09:08:32 [auto1.it] INFO: Scrape type for BE28605: 2
2026-03-30 09:08:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4453287b-8183-5a6a-93f2-1b44acfbb5c9 with identifier: BE28605
2026-03-30 09:08:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4453287b-8183-5a6a-93f2-1b44acfbb5c9 with scrape type 2
2026-03-30 09:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4453287b-8183-5a6a-93f2-1b44acfbb5c9 with scrape type 2
2026-03-30 09:08:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4453287b-8183-5a6a-93f2-1b44acfbb5c9, identifier: BE28605
2026-03-30 09:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4453287b-8183-5a6a-93f2-1b44acfbb5c9 with identifier: BE28605
2026-03-30 09:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4453287b-8183-5a6a-93f2-1b44acfbb5c9 with identifier: BE28605
2026-03-30 09:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4453287b-8183-5a6a-93f2-1b44acfbb5c9 with identifier: BE28605 to the API
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:42:52Z',
 'fuel_type': 'diesel',
 'id': '4453287b-8183-5a6a-93f2-1b44acfbb5c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE28605',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 213857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-10',
 'seller_name': None,
 'title': 'BMW X6 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE28605%27 HTTP/1.1" 200 None
2026-03-30 09:08:32 [auto1.it] INFO: Saving data for BE28605: {'auction_closing_time': 1774885372.0, 'created_time': 1774558944.983323, 'last_price_update_time': 1774861712.773832}
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BE28605') HTTP/1.1" 204 0
2026-03-30 09:08:32 [auto1.it] INFO: Channel: 24h | Page: 49 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:32 [auto1.it] INFO: Found listing with ID: JF19899
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF19899%27 HTTP/1.1" 200 None
2026-03-30 09:08:32 [auto1.it] INFO: Scrape type for JF19899: 0
2026-03-30 09:08:32 [auto1.it] INFO: Found listing with ID: TG15136
2026-03-30 09:08:32 [auto1.it] INFO: Found listing with ID: YG71564
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG71564%27 HTTP/1.1" 200 None
2026-03-30 09:08:32 [auto1.it] INFO: Scrape type for YG71564: 0
2026-03-30 09:08:32 [auto1.it] INFO: Found listing with ID: DT34666
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT34666%27 HTTP/1.1" 200 None
2026-03-30 09:08:32 [auto1.it] INFO: Scrape type for DT34666: 0
2026-03-30 09:08:32 [auto1.it] INFO: Found listing with ID: TK41328
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK41328%27 HTTP/1.1" 200 None
2026-03-30 09:08:32 [auto1.it] INFO: Scrape type for TK41328: 2
2026-03-30 09:08:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f1e7cc9-0ec7-5429-87e2-3ea63e900195 with identifier: TK41328
2026-03-30 09:08:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f1e7cc9-0ec7-5429-87e2-3ea63e900195 with scrape type 2
2026-03-30 09:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f1e7cc9-0ec7-5429-87e2-3ea63e900195 with scrape type 2
2026-03-30 09:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6f1e7cc9-0ec7-5429-87e2-3ea63e900195, identifier: TK41328
2026-03-30 09:08:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6f1e7cc9-0ec7-5429-87e2-3ea63e900195 with identifier: TK41328
2026-03-30 09:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6f1e7cc9-0ec7-5429-87e2-3ea63e900195 with identifier: TK41328
2026-03-30 09:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6f1e7cc9-0ec7-5429-87e2-3ea63e900195 with identifier: TK41328 to the API
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:40:47Z',
 'fuel_type': 'petrol',
 'id': '6f1e7cc9-0ec7-5429-87e2-3ea63e900195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK41328',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 163280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-24',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK41328%27 HTTP/1.1" 200 None
2026-03-30 09:08:33 [auto1.it] INFO: Saving data for TK41328: {'auction_closing_time': 1774885247.0, 'created_time': 1773824455.75578, 'last_price_update_time': 1774861713.287317}
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TK41328') HTTP/1.1" 204 0
2026-03-30 09:08:33 [auto1.it] INFO: Found listing with ID: NP33035
2026-03-30 09:08:33 [auto1.it] INFO: Found listing with ID: LH23447
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH23447%27 HTTP/1.1" 200 None
2026-03-30 09:08:33 [auto1.it] INFO: Scrape type for LH23447: 2
2026-03-30 09:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e44b1a16-29cd-51e0-aea3-c073017bf51a with identifier: LH23447
2026-03-30 09:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e44b1a16-29cd-51e0-aea3-c073017bf51a with scrape type 2
2026-03-30 09:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e44b1a16-29cd-51e0-aea3-c073017bf51a with scrape type 2
2026-03-30 09:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e44b1a16-29cd-51e0-aea3-c073017bf51a, identifier: LH23447
2026-03-30 09:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e44b1a16-29cd-51e0-aea3-c073017bf51a with identifier: LH23447
2026-03-30 09:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e44b1a16-29cd-51e0-aea3-c073017bf51a with identifier: LH23447
2026-03-30 09:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e44b1a16-29cd-51e0-aea3-c073017bf51a with identifier: LH23447 to the API
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:39:07Z',
 'fuel_type': 'petrol',
 'id': 'e44b1a16-29cd-51e0-aea3-c073017bf51a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH23447',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 156589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-08',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH23447%27 HTTP/1.1" 200 None
2026-03-30 09:08:33 [auto1.it] INFO: Saving data for LH23447: {'auction_closing_time': 1774885147.0, 'created_time': 1774559014.255279, 'last_price_update_time': 1774861713.709109}
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LH23447') HTTP/1.1" 204 0
2026-03-30 09:08:33 [auto1.it] INFO: Found listing with ID: NT98508
2026-03-30 09:08:33 [auto1.it] INFO: Found listing with ID: BW44627
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW44627%27 HTTP/1.1" 200 None
2026-03-30 09:08:33 [auto1.it] INFO: Scrape type for BW44627: 0
2026-03-30 09:08:33 [auto1.it] INFO: Found listing with ID: SN54717
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN54717%27 HTTP/1.1" 200 None
2026-03-30 09:08:33 [auto1.it] INFO: Scrape type for SN54717: 2
2026-03-30 09:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd7776f7-2cad-5df8-b724-5e4a8ec5059b with identifier: SN54717
2026-03-30 09:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd7776f7-2cad-5df8-b724-5e4a8ec5059b with scrape type 2
2026-03-30 09:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd7776f7-2cad-5df8-b724-5e4a8ec5059b with scrape type 2
2026-03-30 09:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bd7776f7-2cad-5df8-b724-5e4a8ec5059b, identifier: SN54717
2026-03-30 09:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bd7776f7-2cad-5df8-b724-5e4a8ec5059b with identifier: SN54717
2026-03-30 09:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bd7776f7-2cad-5df8-b724-5e4a8ec5059b with identifier: SN54717
2026-03-30 09:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bd7776f7-2cad-5df8-b724-5e4a8ec5059b with identifier: SN54717 to the API
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:54:24Z',
 'fuel_type': 'diesel',
 'id': 'bd7776f7-2cad-5df8-b724-5e4a8ec5059b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN54717',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 240960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-14',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2017}
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN54717%27 HTTP/1.1" 200 None
2026-03-30 09:08:34 [auto1.it] INFO: Saving data for SN54717: {'auction_closing_time': 1774886064.0, 'created_time': 1774645410.078885, 'last_price_update_time': 1774861714.277682}
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SN54717') HTTP/1.1" 204 0
2026-03-30 09:08:34 [auto1.it] INFO: Found listing with ID: XE50216
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE50216%27 HTTP/1.1" 200 None
2026-03-30 09:08:34 [auto1.it] INFO: Scrape type for XE50216: 2
2026-03-30 09:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db238c5-95f3-50e7-a034-b2d3a8708b2d with identifier: XE50216
2026-03-30 09:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db238c5-95f3-50e7-a034-b2d3a8708b2d with scrape type 2
2026-03-30 09:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db238c5-95f3-50e7-a034-b2d3a8708b2d with scrape type 2
2026-03-30 09:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3db238c5-95f3-50e7-a034-b2d3a8708b2d, identifier: XE50216
2026-03-30 09:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3db238c5-95f3-50e7-a034-b2d3a8708b2d with identifier: XE50216
2026-03-30 09:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3db238c5-95f3-50e7-a034-b2d3a8708b2d with identifier: XE50216
2026-03-30 09:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3db238c5-95f3-50e7-a034-b2d3a8708b2d with identifier: XE50216 to the API
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:27:46Z',
 'fuel_type': 'diesel',
 'id': '3db238c5-95f3-50e7-a034-b2d3a8708b2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE50216',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 303612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-08',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 DRIVe Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2010}
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE50216%27 HTTP/1.1" 200 None
2026-03-30 09:08:34 [auto1.it] INFO: Saving data for XE50216: {'auction_closing_time': 1774884466.0, 'created_time': 1774559051.391705, 'last_price_update_time': 1774861714.718875}
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XE50216') HTTP/1.1" 204 0
2026-03-30 09:08:34 [auto1.it] INFO: Found listing with ID: RA17642
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA17642%27 HTTP/1.1" 200 None
2026-03-30 09:08:34 [auto1.it] INFO: Scrape type for RA17642: 2
2026-03-30 09:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 255546d4-ed00-55ae-8fa3-19a6a5bfe9b1 with identifier: RA17642
2026-03-30 09:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 255546d4-ed00-55ae-8fa3-19a6a5bfe9b1 with scrape type 2
2026-03-30 09:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 255546d4-ed00-55ae-8fa3-19a6a5bfe9b1 with scrape type 2
2026-03-30 09:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 255546d4-ed00-55ae-8fa3-19a6a5bfe9b1, identifier: RA17642
2026-03-30 09:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 255546d4-ed00-55ae-8fa3-19a6a5bfe9b1 with identifier: RA17642
2026-03-30 09:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 255546d4-ed00-55ae-8fa3-19a6a5bfe9b1 with identifier: RA17642
2026-03-30 09:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 255546d4-ed00-55ae-8fa3-19a6a5bfe9b1 with identifier: RA17642 to the API
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:08:00Z',
 'fuel_type': 'petrol',
 'id': '255546d4-ed00-55ae-8fa3-19a6a5bfe9b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA17642',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 49484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Connect',
 'transmission': 'manual',
 'trim': 'Connect',
 'year': 2021}
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA17642%27 HTTP/1.1" 200 None
2026-03-30 09:08:35 [auto1.it] INFO: Saving data for RA17642: {'auction_closing_time': 1774883280.0, 'created_time': 1774645337.762706, 'last_price_update_time': 1774861715.171091}
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA17642') HTTP/1.1" 204 0
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: DP78893
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: ZR71790
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: VS39586
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: WZ23561
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ23561%27 HTTP/1.1" 200 None
2026-03-30 09:08:35 [auto1.it] INFO: Scrape type for WZ23561: 2
2026-03-30 09:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db82f032-482d-52c6-8d3b-1a2de3f9afaa with identifier: WZ23561
2026-03-30 09:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db82f032-482d-52c6-8d3b-1a2de3f9afaa with scrape type 2
2026-03-30 09:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db82f032-482d-52c6-8d3b-1a2de3f9afaa with scrape type 2
2026-03-30 09:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: db82f032-482d-52c6-8d3b-1a2de3f9afaa, identifier: WZ23561
2026-03-30 09:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: db82f032-482d-52c6-8d3b-1a2de3f9afaa with identifier: WZ23561
2026-03-30 09:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: db82f032-482d-52c6-8d3b-1a2de3f9afaa with identifier: WZ23561
2026-03-30 09:08:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: db82f032-482d-52c6-8d3b-1a2de3f9afaa with identifier: WZ23561 to the API
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:29:54Z',
 'fuel_type': 'diesel',
 'id': 'db82f032-482d-52c6-8d3b-1a2de3f9afaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ23561',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 126822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-29',
 'seller_name': None,
 'title': 'Opel Mokka 1.7 CDTI Cosmo',
 'transmission': 'automatic',
 'trim': 'Cosmo',
 'year': 2014}
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ23561%27 HTTP/1.1" 200 None
2026-03-30 09:08:35 [auto1.it] INFO: Saving data for WZ23561: {'auction_closing_time': 1774884594.0, 'created_time': 1774645633.978069, 'last_price_update_time': 1774861715.605866}
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WZ23561') HTTP/1.1" 204 0
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: HU57000
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: KX90230
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX90230%27 HTTP/1.1" 200 None
2026-03-30 09:08:35 [auto1.it] INFO: Scrape type for KX90230: 0
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: MZ03364
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ03364%27 HTTP/1.1" 200 None
2026-03-30 09:08:35 [auto1.it] INFO: Scrape type for MZ03364: 0
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: YH14903
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: TG59717
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: JP72281
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: DW12777
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW12777%27 HTTP/1.1" 200 None
2026-03-30 09:08:35 [auto1.it] INFO: Scrape type for DW12777: 2
2026-03-30 09:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9511c6e9-9a5f-5909-9d5a-dfae09d0a178 with identifier: DW12777
2026-03-30 09:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9511c6e9-9a5f-5909-9d5a-dfae09d0a178 with scrape type 2
2026-03-30 09:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9511c6e9-9a5f-5909-9d5a-dfae09d0a178 with scrape type 2
2026-03-30 09:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9511c6e9-9a5f-5909-9d5a-dfae09d0a178, identifier: DW12777
2026-03-30 09:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9511c6e9-9a5f-5909-9d5a-dfae09d0a178 with identifier: DW12777
2026-03-30 09:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9511c6e9-9a5f-5909-9d5a-dfae09d0a178 with identifier: DW12777
2026-03-30 09:08:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9511c6e9-9a5f-5909-9d5a-dfae09d0a178 with identifier: DW12777 to the API
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:42:54Z',
 'fuel_type': 'diesel',
 'id': '9511c6e9-9a5f-5909-9d5a-dfae09d0a178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW12777',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 216245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-15',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Shooting Brake Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2018}
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW12777%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Saving data for DW12777: {'auction_closing_time': 1774885374.0, 'created_time': 1774645559.441431, 'last_price_update_time': 1774861716.275923}
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DW12777') HTTP/1.1" 204 0
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: RB40748
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB40748%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Scrape type for RB40748: 2
2026-03-30 09:08:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b6bc151-5f00-5486-b3e2-fda46cc6cbb7 with identifier: RB40748
2026-03-30 09:08:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b6bc151-5f00-5486-b3e2-fda46cc6cbb7 with scrape type 2
2026-03-30 09:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b6bc151-5f00-5486-b3e2-fda46cc6cbb7 with scrape type 2
2026-03-30 09:08:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2b6bc151-5f00-5486-b3e2-fda46cc6cbb7, identifier: RB40748
2026-03-30 09:08:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2b6bc151-5f00-5486-b3e2-fda46cc6cbb7 with identifier: RB40748
2026-03-30 09:08:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2b6bc151-5f00-5486-b3e2-fda46cc6cbb7 with identifier: RB40748
2026-03-30 09:08:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2b6bc151-5f00-5486-b3e2-fda46cc6cbb7 with identifier: RB40748 to the API
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:03Z',
 'fuel_type': 'diesel',
 'id': '2b6bc151-5f00-5486-b3e2-fda46cc6cbb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB40748',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 69699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-30',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sport BlueMotion',
 'year': 2019}
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB40748%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Saving data for RB40748: {'auction_closing_time': 1774886343.0, 'created_time': 1774558825.513754, 'last_price_update_time': 1774861716.777291}
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RB40748') HTTP/1.1" 204 0
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: UU51056
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU51056%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Scrape type for UU51056: 0
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: RY04213
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: CW11036
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW11036%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Scrape type for CW11036: 0
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: RM58290
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM58290%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Scrape type for RM58290: 0
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: WV91656
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: RF27989
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: EP92787
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP92787%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Scrape type for EP92787: 0
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: HZ65981
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ65981%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Scrape type for HZ65981: 0
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: VV97216
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV97216%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Scrape type for VV97216: 0
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: PD07113
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: WG94514
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: EP88995
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP88995%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Scrape type for EP88995: 0
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: KT34727
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: LG27793
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: ZR58855
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: HB10468
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: BA64945
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA64945%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Scrape type for BA64945: 0
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: WT06044
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT06044%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Scrape type for WT06044: 2
2026-03-30 09:08:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5f8c18f-d346-52cc-99c8-0a8a2676ae91 with identifier: WT06044
2026-03-30 09:08:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5f8c18f-d346-52cc-99c8-0a8a2676ae91 with scrape type 2
2026-03-30 09:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5f8c18f-d346-52cc-99c8-0a8a2676ae91 with scrape type 2
2026-03-30 09:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b5f8c18f-d346-52cc-99c8-0a8a2676ae91, identifier: WT06044
2026-03-30 09:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b5f8c18f-d346-52cc-99c8-0a8a2676ae91 with identifier: WT06044
2026-03-30 09:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b5f8c18f-d346-52cc-99c8-0a8a2676ae91 with identifier: WT06044
2026-03-30 09:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b5f8c18f-d346-52cc-99c8-0a8a2676ae91 with identifier: WT06044 to the API
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:20:06Z',
 'fuel_type': 'diesel',
 'id': 'b5f8c18f-d346-52cc-99c8-0a8a2676ae91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT06044',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 123580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-22',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 JTD 130',
 'transmission': 'manual',
 'trim': '130',
 'year': 2018}
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT06044%27 HTTP/1.1" 200 None
2026-03-30 09:08:37 [auto1.it] INFO: Saving data for WT06044: {'auction_closing_time': 1774884006.0, 'created_time': 1774645601.654847, 'last_price_update_time': 1774861717.387211}
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WT06044') HTTP/1.1" 204 0
2026-03-30 09:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:37 [auto1.it] INFO: Channel: 24h | Page: 50 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:37 [auto1.it] INFO: Found listing with ID: GM73700
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM73700%27 HTTP/1.1" 200 None
2026-03-30 09:08:37 [auto1.it] INFO: Scrape type for GM73700: 0
2026-03-30 09:08:37 [auto1.it] INFO: Found listing with ID: VV94396
2026-03-30 09:08:37 [auto1.it] INFO: Found listing with ID: ER90508
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER90508%27 HTTP/1.1" 200 None
2026-03-30 09:08:37 [auto1.it] INFO: Scrape type for ER90508: 0
2026-03-30 09:08:37 [auto1.it] INFO: Found listing with ID: UN52705
2026-03-30 09:08:37 [auto1.it] INFO: Found listing with ID: FG85862
2026-03-30 09:08:37 [auto1.it] INFO: Found listing with ID: RN28631
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN28631%27 HTTP/1.1" 200 None
2026-03-30 09:08:38 [auto1.it] INFO: Scrape type for RN28631: 2
2026-03-30 09:08:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b73b4faa-4a00-5d32-92b6-5da1f7460213 with identifier: RN28631
2026-03-30 09:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b73b4faa-4a00-5d32-92b6-5da1f7460213 with scrape type 2
2026-03-30 09:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b73b4faa-4a00-5d32-92b6-5da1f7460213 with scrape type 2
2026-03-30 09:08:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b73b4faa-4a00-5d32-92b6-5da1f7460213, identifier: RN28631
2026-03-30 09:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b73b4faa-4a00-5d32-92b6-5da1f7460213 with identifier: RN28631
2026-03-30 09:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b73b4faa-4a00-5d32-92b6-5da1f7460213 with identifier: RN28631
2026-03-30 09:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b73b4faa-4a00-5d32-92b6-5da1f7460213 with identifier: RN28631 to the API
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:09:00Z',
 'fuel_type': 'diesel',
 'id': 'b73b4faa-4a00-5d32-92b6-5da1f7460213',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN28631',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 64857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-11',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency AMG Sport',
 'transmission': 'manual',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2016}
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN28631%27 HTTP/1.1" 200 None
2026-03-30 09:08:38 [auto1.it] INFO: Saving data for RN28631: {'auction_closing_time': 1774883340.0, 'created_time': 1774645663.697233, 'last_price_update_time': 1774861718.378933}
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RN28631') HTTP/1.1" 204 0
2026-03-30 09:08:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:38 [auto1.it] INFO: Found listing with ID: NE13837
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE13837%27 HTTP/1.1" 200 None
2026-03-30 09:08:38 [auto1.it] INFO: Scrape type for NE13837: 0
2026-03-30 09:08:38 [auto1.it] INFO: Found listing with ID: JJ76443
2026-03-30 09:08:38 [auto1.it] INFO: Found listing with ID: SR58570
2026-03-30 09:08:38 [auto1.it] INFO: Found listing with ID: AG93268
2026-03-30 09:08:38 [auto1.it] INFO: Found listing with ID: YM91095
2026-03-30 09:08:38 [auto1.it] INFO: Found listing with ID: SW20348
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW20348%27 HTTP/1.1" 200 None
2026-03-30 09:08:38 [auto1.it] INFO: Scrape type for SW20348: 2
2026-03-30 09:08:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2637d16c-4e25-526f-a793-bb8045673c9d with identifier: SW20348
2026-03-30 09:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2637d16c-4e25-526f-a793-bb8045673c9d with scrape type 2
2026-03-30 09:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2637d16c-4e25-526f-a793-bb8045673c9d with scrape type 2
2026-03-30 09:08:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2637d16c-4e25-526f-a793-bb8045673c9d, identifier: SW20348
2026-03-30 09:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2637d16c-4e25-526f-a793-bb8045673c9d with identifier: SW20348
2026-03-30 09:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2637d16c-4e25-526f-a793-bb8045673c9d with identifier: SW20348
2026-03-30 09:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2637d16c-4e25-526f-a793-bb8045673c9d with identifier: SW20348 to the API
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:25:19Z',
 'fuel_type': 'diesel',
 'id': '2637d16c-4e25-526f-a793-bb8045673c9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW20348',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 252439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-01',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket plus',
 'year': 2007}
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW20348%27 HTTP/1.1" 200 None
2026-03-30 09:08:38 [auto1.it] INFO: Saving data for SW20348: {'auction_closing_time': 1774884319.0, 'created_time': 1774559057.800022, 'last_price_update_time': 1774861718.927635}
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SW20348') HTTP/1.1" 204 0
2026-03-30 09:08:39 [auto1.it] INFO: Found listing with ID: KH50025
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH50025%27 HTTP/1.1" 200 None
2026-03-30 09:08:39 [auto1.it] INFO: Scrape type for KH50025: 0
2026-03-30 09:08:39 [auto1.it] INFO: Found listing with ID: YD48620
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD48620%27 HTTP/1.1" 200 None
2026-03-30 09:08:39 [auto1.it] INFO: Scrape type for YD48620: 2
2026-03-30 09:08:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 813ba2ed-afaf-5b91-bccf-25a68c4a8309 with identifier: YD48620
2026-03-30 09:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 813ba2ed-afaf-5b91-bccf-25a68c4a8309 with scrape type 2
2026-03-30 09:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 813ba2ed-afaf-5b91-bccf-25a68c4a8309 with scrape type 2
2026-03-30 09:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 813ba2ed-afaf-5b91-bccf-25a68c4a8309, identifier: YD48620
2026-03-30 09:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 813ba2ed-afaf-5b91-bccf-25a68c4a8309 with identifier: YD48620
2026-03-30 09:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 813ba2ed-afaf-5b91-bccf-25a68c4a8309 with identifier: YD48620
2026-03-30 09:08:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 813ba2ed-afaf-5b91-bccf-25a68c4a8309 with identifier: YD48620 to the API
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:28:04Z',
 'fuel_type': 'petrol',
 'id': '813ba2ed-afaf-5b91-bccf-25a68c4a8309',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD48620',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 207751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-06',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Diva',
 'transmission': 'manual',
 'trim': 'Diva',
 'year': 2011}
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD48620%27 HTTP/1.1" 200 None
2026-03-30 09:08:39 [auto1.it] INFO: Saving data for YD48620: {'auction_closing_time': 1774884484.0, 'created_time': 1773134644.024347, 'last_price_update_time': 1774861719.494051}
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YD48620') HTTP/1.1" 204 0
2026-03-30 09:08:39 [auto1.it] INFO: Found listing with ID: CH31271
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH31271%27 HTTP/1.1" 200 None
2026-03-30 09:08:39 [auto1.it] INFO: Scrape type for CH31271: 0
2026-03-30 09:08:39 [auto1.it] INFO: Found listing with ID: NR94524
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR94524%27 HTTP/1.1" 200 None
2026-03-30 09:08:39 [auto1.it] INFO: Scrape type for NR94524: 2
2026-03-30 09:08:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7996cd7-9362-5bf5-a90e-fc6fd4d7fb76 with identifier: NR94524
2026-03-30 09:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7996cd7-9362-5bf5-a90e-fc6fd4d7fb76 with scrape type 2
2026-03-30 09:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7996cd7-9362-5bf5-a90e-fc6fd4d7fb76 with scrape type 2
2026-03-30 09:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7996cd7-9362-5bf5-a90e-fc6fd4d7fb76, identifier: NR94524
2026-03-30 09:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7996cd7-9362-5bf5-a90e-fc6fd4d7fb76 with identifier: NR94524
2026-03-30 09:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7996cd7-9362-5bf5-a90e-fc6fd4d7fb76 with identifier: NR94524
2026-03-30 09:08:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f7996cd7-9362-5bf5-a90e-fc6fd4d7fb76 with identifier: NR94524 to the API
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:08:50Z',
 'fuel_type': 'petrol',
 'id': 'f7996cd7-9362-5bf5-a90e-fc6fd4d7fb76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR94524',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 105970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-23',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.1 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR94524%27 HTTP/1.1" 200 None
2026-03-30 09:08:39 [auto1.it] INFO: Saving data for NR94524: {'auction_closing_time': 1774883330.0, 'created_time': 1774559151.787601, 'last_price_update_time': 1774861719.968519}
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR94524') HTTP/1.1" 204 0
2026-03-30 09:08:39 [auto1.it] INFO: Found listing with ID: ME64112
2026-03-30 09:08:39 [auto1.it] INFO: Found listing with ID: LC62662
2026-03-30 09:08:39 [auto1.it] INFO: Found listing with ID: NG42330
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG42330%27 HTTP/1.1" 200 None
2026-03-30 09:08:40 [auto1.it] INFO: Scrape type for NG42330: 2
2026-03-30 09:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e29c2673-56a5-5b6b-88bd-de443e101d6a with identifier: NG42330
2026-03-30 09:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e29c2673-56a5-5b6b-88bd-de443e101d6a with scrape type 2
2026-03-30 09:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e29c2673-56a5-5b6b-88bd-de443e101d6a with scrape type 2
2026-03-30 09:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e29c2673-56a5-5b6b-88bd-de443e101d6a, identifier: NG42330
2026-03-30 09:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e29c2673-56a5-5b6b-88bd-de443e101d6a with identifier: NG42330
2026-03-30 09:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e29c2673-56a5-5b6b-88bd-de443e101d6a with identifier: NG42330
2026-03-30 09:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e29c2673-56a5-5b6b-88bd-de443e101d6a with identifier: NG42330 to the API
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-30T15:12:35Z',
 'fuel_type': 'petrol',
 'id': 'e29c2673-56a5-5b6b-88bd-de443e101d6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG42330',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 40163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-31',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0-VVT-i X-Cool',
 'transmission': 'automatic',
 'trim': 'X-Cool',
 'year': 2019}
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG42330%27 HTTP/1.1" 200 None
2026-03-30 09:08:40 [auto1.it] INFO: Saving data for NG42330: {'auction_closing_time': 1774883555.0, 'created_time': 1774558975.385333, 'last_price_update_time': 1774861720.347247}
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NG42330') HTTP/1.1" 204 0
2026-03-30 09:08:40 [auto1.it] INFO: Found listing with ID: LY59830
2026-03-30 09:08:40 [auto1.it] INFO: Found listing with ID: GZ29519
2026-03-30 09:08:40 [auto1.it] INFO: Found listing with ID: KW57065
2026-03-30 09:08:40 [auto1.it] INFO: Found listing with ID: XU45966
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU45966%27 HTTP/1.1" 200 None
2026-03-30 09:08:40 [auto1.it] INFO: Scrape type for XU45966: 2
2026-03-30 09:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc79519-b7d1-5d7d-bb69-cae1bbd829c7 with identifier: XU45966
2026-03-30 09:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc79519-b7d1-5d7d-bb69-cae1bbd829c7 with scrape type 2
2026-03-30 09:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffc79519-b7d1-5d7d-bb69-cae1bbd829c7 with scrape type 2
2026-03-30 09:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ffc79519-b7d1-5d7d-bb69-cae1bbd829c7, identifier: XU45966
2026-03-30 09:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ffc79519-b7d1-5d7d-bb69-cae1bbd829c7 with identifier: XU45966
2026-03-30 09:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ffc79519-b7d1-5d7d-bb69-cae1bbd829c7 with identifier: XU45966
2026-03-30 09:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ffc79519-b7d1-5d7d-bb69-cae1bbd829c7 with identifier: XU45966 to the API
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:15:52Z',
 'fuel_type': 'petrol',
 'id': 'ffc79519-b7d1-5d7d-bb69-cae1bbd829c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU45966',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 120524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-26',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2014}
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU45966%27 HTTP/1.1" 200 None
2026-03-30 09:08:40 [auto1.it] INFO: Saving data for XU45966: {'auction_closing_time': 1774883752.0, 'created_time': 1774645631.966252, 'last_price_update_time': 1774861720.782443}
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XU45966') HTTP/1.1" 204 0
2026-03-30 09:08:40 [auto1.it] INFO: Found listing with ID: XP38873
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP38873%27 HTTP/1.1" 200 None
2026-03-30 09:08:40 [auto1.it] INFO: Scrape type for XP38873: 2
2026-03-30 09:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eddc36e3-39c2-55ae-8052-110fb2e715ce with identifier: XP38873
2026-03-30 09:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eddc36e3-39c2-55ae-8052-110fb2e715ce with scrape type 2
2026-03-30 09:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eddc36e3-39c2-55ae-8052-110fb2e715ce with scrape type 2
2026-03-30 09:08:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eddc36e3-39c2-55ae-8052-110fb2e715ce, identifier: XP38873
2026-03-30 09:08:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eddc36e3-39c2-55ae-8052-110fb2e715ce with identifier: XP38873
2026-03-30 09:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eddc36e3-39c2-55ae-8052-110fb2e715ce with identifier: XP38873
2026-03-30 09:08:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eddc36e3-39c2-55ae-8052-110fb2e715ce with identifier: XP38873 to the API
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:55:01Z',
 'fuel_type': 'diesel',
 'id': 'eddc36e3-39c2-55ae-8052-110fb2e715ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP38873',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 211130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Business Class 2WD',
 'transmission': 'automatic',
 'trim': 'Business Class 2WD',
 'year': 2019}
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP38873%27 HTTP/1.1" 200 None
2026-03-30 09:08:41 [auto1.it] INFO: Saving data for XP38873: {'auction_closing_time': 1774886101.0, 'created_time': 1773835766.99403, 'last_price_update_time': 1774861721.308976}
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XP38873') HTTP/1.1" 204 0
2026-03-30 09:08:41 [auto1.it] INFO: Found listing with ID: UA81726
2026-03-30 09:08:41 [auto1.it] INFO: Found listing with ID: LP45822
2026-03-30 09:08:41 [auto1.it] INFO: Found listing with ID: ZZ85760
2026-03-30 09:08:41 [auto1.it] INFO: Found listing with ID: VY12867
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY12867%27 HTTP/1.1" 200 None
2026-03-30 09:08:41 [auto1.it] INFO: Scrape type for VY12867: 2
2026-03-30 09:08:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be543acb-1d2d-5778-9556-89a25340b801 with identifier: VY12867
2026-03-30 09:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be543acb-1d2d-5778-9556-89a25340b801 with scrape type 2
2026-03-30 09:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be543acb-1d2d-5778-9556-89a25340b801 with scrape type 2
2026-03-30 09:08:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be543acb-1d2d-5778-9556-89a25340b801, identifier: VY12867
2026-03-30 09:08:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be543acb-1d2d-5778-9556-89a25340b801 with identifier: VY12867
2026-03-30 09:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be543acb-1d2d-5778-9556-89a25340b801 with identifier: VY12867
2026-03-30 09:08:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be543acb-1d2d-5778-9556-89a25340b801 with identifier: VY12867 to the API
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-30T15:23:38Z',
 'fuel_type': 'petrol',
 'id': 'be543acb-1d2d-5778-9556-89a25340b801',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY12867',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 124812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-10',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Campus Authentique',
 'transmission': 'manual',
 'trim': 'Campus Authentique',
 'year': 2010}
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY12867%27 HTTP/1.1" 200 None
2026-03-30 09:08:41 [auto1.it] INFO: Saving data for VY12867: {'auction_closing_time': 1774884218.0, 'created_time': 1774559019.724112, 'last_price_update_time': 1774861721.886399}
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY12867') HTTP/1.1" 204 0
2026-03-30 09:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:41 [auto1.it] INFO: Found listing with ID: NR23984
2026-03-30 09:08:41 [auto1.it] INFO: Found listing with ID: ET23172
2026-03-30 09:08:41 [auto1.it] INFO: Found listing with ID: TC50511
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC50511%27 HTTP/1.1" 200 None
2026-03-30 09:08:41 [auto1.it] INFO: Scrape type for TC50511: 2
2026-03-30 09:08:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fcaefc6-3abc-50ea-b3ce-2e39e56ad1a8 with identifier: TC50511
2026-03-30 09:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fcaefc6-3abc-50ea-b3ce-2e39e56ad1a8 with scrape type 2
2026-03-30 09:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fcaefc6-3abc-50ea-b3ce-2e39e56ad1a8 with scrape type 2
2026-03-30 09:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9fcaefc6-3abc-50ea-b3ce-2e39e56ad1a8, identifier: TC50511
2026-03-30 09:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9fcaefc6-3abc-50ea-b3ce-2e39e56ad1a8 with identifier: TC50511
2026-03-30 09:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9fcaefc6-3abc-50ea-b3ce-2e39e56ad1a8 with identifier: TC50511
2026-03-30 09:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9fcaefc6-3abc-50ea-b3ce-2e39e56ad1a8 with identifier: TC50511 to the API
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:53:55Z',
 'fuel_type': 'diesel',
 'id': '9fcaefc6-3abc-50ea-b3ce-2e39e56ad1a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC50511',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 76684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-29',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC50511%27 HTTP/1.1" 200 None
2026-03-30 09:08:42 [auto1.it] INFO: Saving data for TC50511: {'auction_closing_time': 1774886035.0, 'created_time': 1774559108.326207, 'last_price_update_time': 1774861722.374116}
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TC50511') HTTP/1.1" 204 0
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: FN23706
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN23706%27 HTTP/1.1" 200 None
2026-03-30 09:08:42 [auto1.it] INFO: Scrape type for FN23706: 0
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: FK20941
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK20941%27 HTTP/1.1" 200 None
2026-03-30 09:08:42 [auto1.it] INFO: Scrape type for FK20941: 2
2026-03-30 09:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baa11704-80c4-57f2-bfda-665cf7d28c5a with identifier: FK20941
2026-03-30 09:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baa11704-80c4-57f2-bfda-665cf7d28c5a with scrape type 2
2026-03-30 09:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baa11704-80c4-57f2-bfda-665cf7d28c5a with scrape type 2
2026-03-30 09:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: baa11704-80c4-57f2-bfda-665cf7d28c5a, identifier: FK20941
2026-03-30 09:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: baa11704-80c4-57f2-bfda-665cf7d28c5a with identifier: FK20941
2026-03-30 09:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: baa11704-80c4-57f2-bfda-665cf7d28c5a with identifier: FK20941
2026-03-30 09:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: baa11704-80c4-57f2-bfda-665cf7d28c5a with identifier: FK20941 to the API
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 144,
 'expiration_date': '2026-03-30T15:25:25Z',
 'fuel_type': 'diesel',
 'id': 'baa11704-80c4-57f2-bfda-665cf7d28c5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK20941',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 239653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 2.0 D-4D L2 Lounge',
 'transmission': 'manual',
 'trim': 'L2 Lounge',
 'year': 2022}
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK20941%27 HTTP/1.1" 200 None
2026-03-30 09:08:42 [auto1.it] INFO: Saving data for FK20941: {'auction_closing_time': 1774884325.0, 'created_time': 1774645697.406584, 'last_price_update_time': 1774861722.806311}
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FK20941') HTTP/1.1" 204 0
2026-03-30 09:08:42 [auto1.it] INFO: Channel: 24h | Page: 51 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: VC63991
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC63991%27 HTTP/1.1" 200 None
2026-03-30 09:08:42 [auto1.it] INFO: Scrape type for VC63991: 0
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: ZK25944
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: VP99832
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: MU83341
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU83341%27 HTTP/1.1" 200 None
2026-03-30 09:08:42 [auto1.it] INFO: Scrape type for MU83341: 0
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: EC55479
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC55479%27 HTTP/1.1" 200 None
2026-03-30 09:08:42 [auto1.it] INFO: Scrape type for EC55479: 2
2026-03-30 09:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe8a0e12-d471-54c1-89f8-f4cc1c76df32 with identifier: EC55479
2026-03-30 09:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe8a0e12-d471-54c1-89f8-f4cc1c76df32 with scrape type 2
2026-03-30 09:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe8a0e12-d471-54c1-89f8-f4cc1c76df32 with scrape type 2
2026-03-30 09:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fe8a0e12-d471-54c1-89f8-f4cc1c76df32, identifier: EC55479
2026-03-30 09:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fe8a0e12-d471-54c1-89f8-f4cc1c76df32 with identifier: EC55479
2026-03-30 09:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fe8a0e12-d471-54c1-89f8-f4cc1c76df32 with identifier: EC55479
2026-03-30 09:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fe8a0e12-d471-54c1-89f8-f4cc1c76df32 with identifier: EC55479 to the API
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:32:01Z',
 'fuel_type': 'diesel',
 'id': 'fe8a0e12-d471-54c1-89f8-f4cc1c76df32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC55479',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 184326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-20',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC55479%27 HTTP/1.1" 200 None
2026-03-30 09:08:43 [auto1.it] INFO: Saving data for EC55479: {'auction_closing_time': 1774884721.0, 'created_time': 1773824504.167463, 'last_price_update_time': 1774861723.273461}
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC55479') HTTP/1.1" 204 0
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: YH05705
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH05705%27 HTTP/1.1" 200 None
2026-03-30 09:08:43 [auto1.it] INFO: Scrape type for YH05705: 2
2026-03-30 09:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 969e6156-c938-54cb-9b06-a83ada583e4d with identifier: YH05705
2026-03-30 09:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 969e6156-c938-54cb-9b06-a83ada583e4d with scrape type 2
2026-03-30 09:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 969e6156-c938-54cb-9b06-a83ada583e4d with scrape type 2
2026-03-30 09:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 969e6156-c938-54cb-9b06-a83ada583e4d, identifier: YH05705
2026-03-30 09:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: JE16682
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: VP75887
2026-03-30 09:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 969e6156-c938-54cb-9b06-a83ada583e4d with identifier: YH05705
2026-03-30 09:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 969e6156-c938-54cb-9b06-a83ada583e4d with identifier: YH05705
2026-03-30 09:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 969e6156-c938-54cb-9b06-a83ada583e4d with identifier: YH05705 to the API
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-30T15:17:21Z',
 'fuel_type': 'diesel',
 'id': '969e6156-c938-54cb-9b06-a83ada583e4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH05705',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 327664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-20',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2007}
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH05705%27 HTTP/1.1" 200 None
2026-03-30 09:08:43 [auto1.it] INFO: Saving data for YH05705: {'auction_closing_time': 1774883841.0, 'created_time': 1774645617.584739, 'last_price_update_time': 1774861723.780777}
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YH05705') HTTP/1.1" 204 0
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: DN97608
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN97608%27 HTTP/1.1" 200 None
2026-03-30 09:08:43 [auto1.it] INFO: Scrape type for DN97608: 0
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: AF46529
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: BJ63933
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ63933%27 HTTP/1.1" 200 None
2026-03-30 09:08:43 [auto1.it] INFO: Scrape type for BJ63933: 0
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: LW86872
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: PA70519
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: UT42979
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: RS56443
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS56443%27 HTTP/1.1" 200 None
2026-03-30 09:08:43 [auto1.it] INFO: Scrape type for RS56443: 0
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: LN57194
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: HY22945
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: CC46702
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC46702%27 HTTP/1.1" 200 None
2026-03-30 09:08:43 [auto1.it] INFO: Scrape type for CC46702: 2
2026-03-30 09:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23499c42-46ae-5bf3-b6d3-51a6fff40449 with identifier: CC46702
2026-03-30 09:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23499c42-46ae-5bf3-b6d3-51a6fff40449 with scrape type 2
2026-03-30 09:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23499c42-46ae-5bf3-b6d3-51a6fff40449 with scrape type 2
2026-03-30 09:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 23499c42-46ae-5bf3-b6d3-51a6fff40449, identifier: CC46702
2026-03-30 09:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 23499c42-46ae-5bf3-b6d3-51a6fff40449 with identifier: CC46702
2026-03-30 09:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 23499c42-46ae-5bf3-b6d3-51a6fff40449 with identifier: CC46702
2026-03-30 09:08:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 23499c42-46ae-5bf3-b6d3-51a6fff40449 with identifier: CC46702 to the API
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:14:28Z',
 'fuel_type': 'diesel',
 'id': '23499c42-46ae-5bf3-b6d3-51a6fff40449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC46702',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 177120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-21',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'automatic',
 'trim': 'Limited FWD',
 'year': 2017}
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC46702%27 HTTP/1.1" 200 None
2026-03-30 09:08:44 [auto1.it] INFO: Saving data for CC46702: {'auction_closing_time': 1774883668.0, 'created_time': 1772188124.24208, 'last_price_update_time': 1774861724.305799}
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CC46702') HTTP/1.1" 204 0
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: PL71131
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL71131%27 HTTP/1.1" 200 None
2026-03-30 09:08:44 [auto1.it] INFO: Scrape type for PL71131: 0
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: JG85699
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: AK60352
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: YA87774
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: PN28374
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: VA22015
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: MR41650
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR41650%27 HTTP/1.1" 200 None
2026-03-30 09:08:44 [auto1.it] INFO: Scrape type for MR41650: 0
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: AN53744
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN53744%27 HTTP/1.1" 200 None
2026-03-30 09:08:44 [auto1.it] INFO: Scrape type for AN53744: 2
2026-03-30 09:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a05e9c8b-6454-55fe-9c09-b2c7612036f7 with identifier: AN53744
2026-03-30 09:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a05e9c8b-6454-55fe-9c09-b2c7612036f7 with scrape type 2
2026-03-30 09:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a05e9c8b-6454-55fe-9c09-b2c7612036f7 with scrape type 2
2026-03-30 09:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a05e9c8b-6454-55fe-9c09-b2c7612036f7, identifier: AN53744
2026-03-30 09:08:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a05e9c8b-6454-55fe-9c09-b2c7612036f7 with identifier: AN53744
2026-03-30 09:08:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a05e9c8b-6454-55fe-9c09-b2c7612036f7 with identifier: AN53744
2026-03-30 09:08:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a05e9c8b-6454-55fe-9c09-b2c7612036f7 with identifier: AN53744 to the API
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:01:16Z',
 'fuel_type': 'diesel',
 'id': 'a05e9c8b-6454-55fe-9c09-b2c7612036f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN53744',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 265074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN53744%27 HTTP/1.1" 200 None
2026-03-30 09:08:44 [auto1.it] INFO: Saving data for AN53744: {'auction_closing_time': 1774882876.0, 'created_time': 1774645563.743632, 'last_price_update_time': 1774861724.87771}
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AN53744') HTTP/1.1" 204 0
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: KL25988
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL25988%27 HTTP/1.1" 200 None
2026-03-30 09:08:44 [auto1.it] INFO: Scrape type for KL25988: 0
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: NL15395
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: ZW56281
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: KK35105
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK35105%27 HTTP/1.1" 200 None
2026-03-30 09:08:44 [auto1.it] INFO: Scrape type for KK35105: 0
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: GZ99467
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: ER51817
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER51817%27 HTTP/1.1" 200 None
2026-03-30 09:08:44 [auto1.it] INFO: Scrape type for ER51817: 0
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: GB19602
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB19602%27 HTTP/1.1" 200 None
2026-03-30 09:08:44 [auto1.it] INFO: Scrape type for GB19602: 2
2026-03-30 09:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca6345b3-b775-5257-af3b-942d8a0d40ed with identifier: GB19602
2026-03-30 09:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca6345b3-b775-5257-af3b-942d8a0d40ed with scrape type 2
2026-03-30 09:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca6345b3-b775-5257-af3b-942d8a0d40ed with scrape type 2
2026-03-30 09:08:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ca6345b3-b775-5257-af3b-942d8a0d40ed, identifier: GB19602
2026-03-30 09:08:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ca6345b3-b775-5257-af3b-942d8a0d40ed with identifier: GB19602
2026-03-30 09:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ca6345b3-b775-5257-af3b-942d8a0d40ed with identifier: GB19602
2026-03-30 09:08:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ca6345b3-b775-5257-af3b-942d8a0d40ed with identifier: GB19602 to the API
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:32:24Z',
 'fuel_type': 'petrol',
 'id': 'ca6345b3-b775-5257-af3b-942d8a0d40ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB19602',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 139924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2011}
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB19602%27 HTTP/1.1" 200 None
2026-03-30 09:08:45 [auto1.it] INFO: Saving data for GB19602: {'auction_closing_time': 1774884744.0, 'created_time': 1773868072.278737, 'last_price_update_time': 1774861725.336248}
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GB19602') HTTP/1.1" 204 0
2026-03-30 09:08:45 [auto1.it] INFO: Found listing with ID: SR85753
2026-03-30 09:08:45 [auto1.it] INFO: Found listing with ID: WD12881
2026-03-30 09:08:45 [auto1.it] INFO: Found listing with ID: NP37024
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP37024%27 HTTP/1.1" 200 None
2026-03-30 09:08:45 [auto1.it] INFO: Scrape type for NP37024: 0
2026-03-30 09:08:45 [auto1.it] INFO: Found listing with ID: WB02861
2026-03-30 09:08:45 [auto1.it] INFO: Found listing with ID: YG18213
2026-03-30 09:08:45 [auto1.it] INFO: Found listing with ID: NA90799
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA90799%27 HTTP/1.1" 200 None
2026-03-30 09:08:45 [auto1.it] INFO: Scrape type for NA90799: 2
2026-03-30 09:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3334e4e4-b749-5743-9ec3-05870e51b78c with identifier: NA90799
2026-03-30 09:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3334e4e4-b749-5743-9ec3-05870e51b78c with scrape type 2
2026-03-30 09:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3334e4e4-b749-5743-9ec3-05870e51b78c with scrape type 2
2026-03-30 09:08:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3334e4e4-b749-5743-9ec3-05870e51b78c, identifier: NA90799
2026-03-30 09:08:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3334e4e4-b749-5743-9ec3-05870e51b78c with identifier: NA90799
2026-03-30 09:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3334e4e4-b749-5743-9ec3-05870e51b78c with identifier: NA90799
2026-03-30 09:08:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3334e4e4-b749-5743-9ec3-05870e51b78c with identifier: NA90799 to the API
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:55:10Z',
 'fuel_type': 'diesel',
 'id': '3334e4e4-b749-5743-9ec3-05870e51b78c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA90799',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 199413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-06',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA90799%27 HTTP/1.1" 200 None
2026-03-30 09:08:46 [auto1.it] INFO: Saving data for NA90799: {'auction_closing_time': 1774886110.0, 'created_time': 1774559150.397011, 'last_price_update_time': 1774861726.071839}
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NA90799') HTTP/1.1" 204 0
2026-03-30 09:08:46 [auto1.it] INFO: Found listing with ID: JB43722
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB43722%27 HTTP/1.1" 200 None
2026-03-30 09:08:46 [auto1.it] INFO: Scrape type for JB43722: 0
2026-03-30 09:08:46 [auto1.it] INFO: Found listing with ID: SY65620
2026-03-30 09:08:46 [auto1.it] INFO: Found listing with ID: VC37401
2026-03-30 09:08:46 [auto1.it] INFO: Found listing with ID: JB22661
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB22661%27 HTTP/1.1" 200 None
2026-03-30 09:08:46 [auto1.it] INFO: Scrape type for JB22661: 0
2026-03-30 09:08:46 [auto1.it] INFO: Found listing with ID: CH30071
2026-03-30 09:08:46 [auto1.it] INFO: Found listing with ID: PS88419
2026-03-30 09:08:46 [auto1.it] INFO: Found listing with ID: SG58934
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG58934%27 HTTP/1.1" 200 None
2026-03-30 09:08:46 [auto1.it] INFO: Scrape type for SG58934: 2
2026-03-30 09:08:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62abdf56-76ed-5464-9702-505025d0727f with identifier: SG58934
2026-03-30 09:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62abdf56-76ed-5464-9702-505025d0727f with scrape type 2
2026-03-30 09:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62abdf56-76ed-5464-9702-505025d0727f with scrape type 2
2026-03-30 09:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 62abdf56-76ed-5464-9702-505025d0727f, identifier: SG58934
2026-03-30 09:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 62abdf56-76ed-5464-9702-505025d0727f with identifier: SG58934
2026-03-30 09:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 62abdf56-76ed-5464-9702-505025d0727f with identifier: SG58934
2026-03-30 09:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 62abdf56-76ed-5464-9702-505025d0727f with identifier: SG58934 to the API
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:56:52Z',
 'fuel_type': 'diesel',
 'id': '62abdf56-76ed-5464-9702-505025d0727f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG58934',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 183734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-18',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Executive BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Executive BlueMotion Tech',
 'year': 2016}
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG58934%27 HTTP/1.1" 200 None
2026-03-30 09:08:46 [auto1.it] INFO: Saving data for SG58934: {'auction_closing_time': 1774886212.0, 'created_time': 1774645682.395451, 'last_price_update_time': 1774861726.635858}
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SG58934') HTTP/1.1" 204 0
2026-03-30 09:08:46 [auto1.it] INFO: Found listing with ID: WP29588
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP29588%27 HTTP/1.1" 200 None
2026-03-30 09:08:46 [auto1.it] INFO: Scrape type for WP29588: 0
2026-03-30 09:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:46 [auto1.it] INFO: Channel: 24h | Page: 52 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:46 [auto1.it] INFO: Found listing with ID: EH79430
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH79430%27 HTTP/1.1" 200 None
2026-03-30 09:08:46 [auto1.it] INFO: Scrape type for EH79430: 0
2026-03-30 09:08:46 [auto1.it] INFO: Found listing with ID: ZY20684
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY20684%27 HTTP/1.1" 200 None
2026-03-30 09:08:46 [auto1.it] INFO: Scrape type for ZY20684: 2
2026-03-30 09:08:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79896cae-1c5a-5b7e-adf8-7a00f19fd894 with identifier: ZY20684
2026-03-30 09:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79896cae-1c5a-5b7e-adf8-7a00f19fd894 with scrape type 2
2026-03-30 09:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79896cae-1c5a-5b7e-adf8-7a00f19fd894 with scrape type 2
2026-03-30 09:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 79896cae-1c5a-5b7e-adf8-7a00f19fd894, identifier: ZY20684
2026-03-30 09:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 79896cae-1c5a-5b7e-adf8-7a00f19fd894 with identifier: ZY20684
2026-03-30 09:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 79896cae-1c5a-5b7e-adf8-7a00f19fd894 with identifier: ZY20684
2026-03-30 09:08:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 79896cae-1c5a-5b7e-adf8-7a00f19fd894 with identifier: ZY20684 to the API
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:47:48Z',
 'fuel_type': 'petrol',
 'id': '79896cae-1c5a-5b7e-adf8-7a00f19fd894',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY20684',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 143433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-31',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY20684%27 HTTP/1.1" 200 None
2026-03-30 09:08:47 [auto1.it] INFO: Saving data for ZY20684: {'auction_closing_time': 1774885668.0, 'created_time': 1774645693.891224, 'last_price_update_time': 1774861727.314055}
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZY20684') HTTP/1.1" 204 0
2026-03-30 09:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:47 [auto1.it] INFO: Found listing with ID: ZE54964
2026-03-30 09:08:47 [auto1.it] INFO: Found listing with ID: SH99694
2026-03-30 09:08:47 [auto1.it] INFO: Found listing with ID: YD47870
2026-03-30 09:08:47 [auto1.it] INFO: Found listing with ID: HP26181
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP26181%27 HTTP/1.1" 200 None
2026-03-30 09:08:47 [auto1.it] INFO: Scrape type for HP26181: 0
2026-03-30 09:08:47 [auto1.it] INFO: Found listing with ID: CA11225
2026-03-30 09:08:47 [auto1.it] INFO: Found listing with ID: GZ15334
2026-03-30 09:08:47 [auto1.it] INFO: Found listing with ID: NR19227
2026-03-30 09:08:47 [auto1.it] INFO: Found listing with ID: PE03343
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE03343%27 HTTP/1.1" 200 None
2026-03-30 09:08:47 [auto1.it] INFO: Scrape type for PE03343: 2
2026-03-30 09:08:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 262288ba-6ff9-52e8-8981-ace6bcddf367 with identifier: PE03343
2026-03-30 09:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 262288ba-6ff9-52e8-8981-ace6bcddf367 with scrape type 2
2026-03-30 09:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 262288ba-6ff9-52e8-8981-ace6bcddf367 with scrape type 2
2026-03-30 09:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 262288ba-6ff9-52e8-8981-ace6bcddf367, identifier: PE03343
2026-03-30 09:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 262288ba-6ff9-52e8-8981-ace6bcddf367 with identifier: PE03343
2026-03-30 09:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 262288ba-6ff9-52e8-8981-ace6bcddf367 with identifier: PE03343
2026-03-30 09:08:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 262288ba-6ff9-52e8-8981-ace6bcddf367 with identifier: PE03343 to the API
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:34:44Z',
 'fuel_type': 'petrol',
 'id': '262288ba-6ff9-52e8-8981-ace6bcddf367',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE03343',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 64663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-04',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Oro',
 'transmission': 'manual',
 'trim': 'Oro',
 'year': 2006}
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE03343%27 HTTP/1.1" 200 None
2026-03-30 09:08:47 [auto1.it] INFO: Saving data for PE03343: {'auction_closing_time': 1774884884.0, 'created_time': 1773135538.04005, 'last_price_update_time': 1774861727.763371}
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PE03343') HTTP/1.1" 204 0
2026-03-30 09:08:47 [auto1.it] INFO: Found listing with ID: MG44195
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG44195%27 HTTP/1.1" 200 None
2026-03-30 09:08:47 [auto1.it] INFO: Scrape type for MG44195: 2
2026-03-30 09:08:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24d56993-9f09-5656-ae3a-2c91353e1f95 with identifier: MG44195
2026-03-30 09:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24d56993-9f09-5656-ae3a-2c91353e1f95 with scrape type 2
2026-03-30 09:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24d56993-9f09-5656-ae3a-2c91353e1f95 with scrape type 2
2026-03-30 09:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 24d56993-9f09-5656-ae3a-2c91353e1f95, identifier: MG44195
2026-03-30 09:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 24d56993-9f09-5656-ae3a-2c91353e1f95 with identifier: MG44195
2026-03-30 09:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 24d56993-9f09-5656-ae3a-2c91353e1f95 with identifier: MG44195
2026-03-30 09:08:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 24d56993-9f09-5656-ae3a-2c91353e1f95 with identifier: MG44195 to the API
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:59:32Z',
 'fuel_type': 'diesel',
 'id': '24d56993-9f09-5656-ae3a-2c91353e1f95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG44195',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 221111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-29',
 'seller_name': None,
 'title': 'Hyundai i40 1.7 CRDi Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2012}
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG44195%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [auto1.it] INFO: Saving data for MG44195: {'auction_closing_time': 1774886372.0, 'created_time': 1773135719.239063, 'last_price_update_time': 1774861728.253654}
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MG44195') HTTP/1.1" 204 0
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: CD48597
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: ZL42866
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: TD16332
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD16332%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [auto1.it] INFO: Scrape type for TD16332: 0
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: XX72612
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX72612%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [auto1.it] INFO: Scrape type for XX72612: 2
2026-03-30 09:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35998ffb-020e-508f-a0e7-cc66ed51f33f with identifier: XX72612
2026-03-30 09:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35998ffb-020e-508f-a0e7-cc66ed51f33f with scrape type 2
2026-03-30 09:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35998ffb-020e-508f-a0e7-cc66ed51f33f with scrape type 2
2026-03-30 09:08:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 35998ffb-020e-508f-a0e7-cc66ed51f33f, identifier: XX72612
2026-03-30 09:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 35998ffb-020e-508f-a0e7-cc66ed51f33f with identifier: XX72612
2026-03-30 09:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 35998ffb-020e-508f-a0e7-cc66ed51f33f with identifier: XX72612
2026-03-30 09:08:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 35998ffb-020e-508f-a0e7-cc66ed51f33f with identifier: XX72612 to the API
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:54:22Z',
 'fuel_type': 'diesel',
 'id': '35998ffb-020e-508f-a0e7-cc66ed51f33f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX72612',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 352011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-27',
 'seller_name': None,
 'title': 'Peugeot 307 1.6 HDi SW Australian',
 'transmission': 'manual',
 'trim': 'SW Australian',
 'year': 2007}
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX72612%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [auto1.it] INFO: Saving data for XX72612: {'auction_closing_time': 1774886062.0, 'created_time': 1774645634.594942, 'last_price_update_time': 1774861728.715762}
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX72612') HTTP/1.1" 204 0
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: FZ15341
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: FB65897
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: UJ60071
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ60071%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [auto1.it] INFO: Scrape type for UJ60071: 0
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: LU21739
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU21739%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [auto1.it] INFO: Scrape type for LU21739: 0
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: JD30560
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: WM75200
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM75200%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [auto1.it] INFO: Scrape type for WM75200: 0
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: TW16481
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: HE90318
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE90318%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [auto1.it] INFO: Scrape type for HE90318: 0
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: JZ67202
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ67202%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [auto1.it] INFO: Scrape type for JZ67202: 2
2026-03-30 09:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f447a75-9b7d-58d7-ab61-a1fabfc474ff with identifier: JZ67202
2026-03-30 09:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f447a75-9b7d-58d7-ab61-a1fabfc474ff with scrape type 2
2026-03-30 09:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f447a75-9b7d-58d7-ab61-a1fabfc474ff with scrape type 2
2026-03-30 09:08:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7f447a75-9b7d-58d7-ab61-a1fabfc474ff, identifier: JZ67202
2026-03-30 09:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f447a75-9b7d-58d7-ab61-a1fabfc474ff with identifier: JZ67202
2026-03-30 09:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f447a75-9b7d-58d7-ab61-a1fabfc474ff with identifier: JZ67202
2026-03-30 09:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f447a75-9b7d-58d7-ab61-a1fabfc474ff with identifier: JZ67202 to the API
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:16:35Z',
 'fuel_type': 'diesel',
 'id': '7f447a75-9b7d-58d7-ab61-a1fabfc474ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ67202',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 86363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2011}
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ67202%27 HTTP/1.1" 200 None
2026-03-30 09:08:49 [auto1.it] INFO: Saving data for JZ67202: {'auction_closing_time': 1774883795.0, 'created_time': 1774645334.67533, 'last_price_update_time': 1774861729.209538}
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ67202') HTTP/1.1" 204 0
2026-03-30 09:08:49 [auto1.it] INFO: Found listing with ID: XJ00543
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ00543%27 HTTP/1.1" 200 None
2026-03-30 09:08:49 [auto1.it] INFO: Scrape type for XJ00543: 0
2026-03-30 09:08:49 [auto1.it] INFO: Found listing with ID: HG18459
2026-03-30 09:08:49 [auto1.it] INFO: Found listing with ID: RS41050
2026-03-30 09:08:49 [auto1.it] INFO: Found listing with ID: YX10047
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX10047%27 HTTP/1.1" 200 None
2026-03-30 09:08:49 [auto1.it] INFO: Scrape type for YX10047: 0
2026-03-30 09:08:49 [auto1.it] INFO: Found listing with ID: KD38461
2026-03-30 09:08:49 [auto1.it] INFO: Found listing with ID: HS22192
2026-03-30 09:08:49 [auto1.it] INFO: Found listing with ID: UA91591
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA91591%27 HTTP/1.1" 200 None
2026-03-30 09:08:49 [auto1.it] INFO: Scrape type for UA91591: 0
2026-03-30 09:08:49 [auto1.it] INFO: Found listing with ID: VC28315
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC28315%27 HTTP/1.1" 200 None
2026-03-30 09:08:49 [auto1.it] INFO: Scrape type for VC28315: 2
2026-03-30 09:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bec828da-d4e8-5b70-a240-feb6358f4209 with identifier: VC28315
2026-03-30 09:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec828da-d4e8-5b70-a240-feb6358f4209 with scrape type 2
2026-03-30 09:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bec828da-d4e8-5b70-a240-feb6358f4209 with scrape type 2
2026-03-30 09:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bec828da-d4e8-5b70-a240-feb6358f4209, identifier: VC28315
2026-03-30 09:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bec828da-d4e8-5b70-a240-feb6358f4209 with identifier: VC28315
2026-03-30 09:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bec828da-d4e8-5b70-a240-feb6358f4209 with identifier: VC28315
2026-03-30 09:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bec828da-d4e8-5b70-a240-feb6358f4209 with identifier: VC28315 to the API
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:20:33Z',
 'fuel_type': 'petrol',
 'id': 'bec828da-d4e8-5b70-a240-feb6358f4209',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC28315',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 175997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-03',
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC28315%27 HTTP/1.1" 200 None
2026-03-30 09:08:49 [auto1.it] INFO: Saving data for VC28315: {'auction_closing_time': 1774884033.0, 'created_time': 1774558833.433333, 'last_price_update_time': 1774861729.999614}
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VC28315') HTTP/1.1" 204 0
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: XC32215
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: VJ93406
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: PE96276
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE96276%27 HTTP/1.1" 200 None
2026-03-30 09:08:50 [auto1.it] INFO: Scrape type for PE96276: 0
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: HA39708
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: SG53706
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: CU47897
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: RL61545
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: XC82626
2026-03-30 09:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:50 [auto1.it] INFO: Channel: 24h | Page: 53 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: SU56229
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: PN01400
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: SS15336
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS15336%27 HTTP/1.1" 200 None
2026-03-30 09:08:50 [auto1.it] INFO: Scrape type for SS15336: 0
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: YW98083
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: XA66823
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XA66823%27 HTTP/1.1" 200 None
2026-03-30 09:08:50 [auto1.it] INFO: Scrape type for XA66823: 0
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: MM82110
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: EG94847
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG94847%27 HTTP/1.1" 200 None
2026-03-30 09:08:51 [auto1.it] INFO: Scrape type for EG94847: 0
2026-03-30 09:08:51 [auto1.it] INFO: Found listing with ID: YM64414
2026-03-30 09:08:51 [auto1.it] INFO: Found listing with ID: MD14180
2026-03-30 09:08:51 [auto1.it] INFO: Found listing with ID: KW88913
2026-03-30 09:08:51 [auto1.it] INFO: Found listing with ID: BX20882
2026-03-30 09:08:51 [auto1.it] INFO: Found listing with ID: RJ76809
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ76809%27 HTTP/1.1" 200 None
2026-03-30 09:08:51 [auto1.it] INFO: Scrape type for RJ76809: 0
2026-03-30 09:08:51 [auto1.it] INFO: Found listing with ID: YT99583
2026-03-30 09:08:51 [auto1.it] INFO: Found listing with ID: MS79311
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS79311%27 HTTP/1.1" 200 None
2026-03-30 09:08:51 [auto1.it] INFO: Scrape type for MS79311: 0
2026-03-30 09:08:51 [auto1.it] INFO: Found listing with ID: WU32452
2026-03-30 09:08:51 [auto1.it] INFO: Found listing with ID: BL33415
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL33415%27 HTTP/1.1" 200 None
2026-03-30 09:08:51 [auto1.it] INFO: Scrape type for BL33415: 2
2026-03-30 09:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01ce79c7-30e2-5cbd-bf24-f84b96276ed8 with identifier: BL33415
2026-03-30 09:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01ce79c7-30e2-5cbd-bf24-f84b96276ed8 with scrape type 2
2026-03-30 09:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01ce79c7-30e2-5cbd-bf24-f84b96276ed8 with scrape type 2
2026-03-30 09:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 01ce79c7-30e2-5cbd-bf24-f84b96276ed8, identifier: BL33415
2026-03-30 09:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 01ce79c7-30e2-5cbd-bf24-f84b96276ed8 with identifier: BL33415
2026-03-30 09:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 01ce79c7-30e2-5cbd-bf24-f84b96276ed8 with identifier: BL33415
2026-03-30 09:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 01ce79c7-30e2-5cbd-bf24-f84b96276ed8 with identifier: BL33415 to the API
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:22:41Z',
 'fuel_type': 'petrol',
 'id': '01ce79c7-30e2-5cbd-bf24-f84b96276ed8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL33415',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 167059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Cosmo ecoFlex',
 'transmission': 'manual',
 'trim': 'Cosmo ecoFlex',
 'year': 2016}
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL33415%27 HTTP/1.1" 200 None
2026-03-30 09:08:51 [auto1.it] INFO: Saving data for BL33415: {'auction_closing_time': 1774884161.0, 'created_time': 1772625754.70361, 'last_price_update_time': 1774861731.492941}
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BL33415') HTTP/1.1" 204 0
2026-03-30 09:08:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:51 [auto1.it] INFO: Found listing with ID: ZJ46829
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ46829%27 HTTP/1.1" 200 None
2026-03-30 09:08:51 [auto1.it] INFO: Scrape type for ZJ46829: 2
2026-03-30 09:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45974b1c-60db-5c29-bb6e-0ace42c0f285 with identifier: ZJ46829
2026-03-30 09:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45974b1c-60db-5c29-bb6e-0ace42c0f285 with scrape type 2
2026-03-30 09:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45974b1c-60db-5c29-bb6e-0ace42c0f285 with scrape type 2
2026-03-30 09:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 45974b1c-60db-5c29-bb6e-0ace42c0f285, identifier: ZJ46829
2026-03-30 09:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 45974b1c-60db-5c29-bb6e-0ace42c0f285 with identifier: ZJ46829
2026-03-30 09:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 45974b1c-60db-5c29-bb6e-0ace42c0f285 with identifier: ZJ46829
2026-03-30 09:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 45974b1c-60db-5c29-bb6e-0ace42c0f285 with identifier: ZJ46829 to the API
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:17:35Z',
 'fuel_type': 'diesel',
 'id': '45974b1c-60db-5c29-bb6e-0ace42c0f285',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ46829',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 119853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-11',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ46829%27 HTTP/1.1" 200 None
2026-03-30 09:08:51 [auto1.it] INFO: Saving data for ZJ46829: {'auction_closing_time': 1774883855.0, 'created_time': 1774558967.00803, 'last_price_update_time': 1774861731.999308}
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZJ46829') HTTP/1.1" 204 0
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: ZJ21397
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ21397%27 HTTP/1.1" 200 None
2026-03-30 09:08:52 [auto1.it] INFO: Scrape type for ZJ21397: 0
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: JK56818
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK56818%27 HTTP/1.1" 200 None
2026-03-30 09:08:52 [auto1.it] INFO: Scrape type for JK56818: 0
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: JD30640
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: MV49803
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV49803%27 HTTP/1.1" 200 None
2026-03-30 09:08:52 [auto1.it] INFO: Scrape type for MV49803: 0
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: MZ03960
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ03960%27 HTTP/1.1" 200 None
2026-03-30 09:08:52 [auto1.it] INFO: Scrape type for MZ03960: 0
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: JL83365
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL83365%27 HTTP/1.1" 200 None
2026-03-30 09:08:52 [auto1.it] INFO: Scrape type for JL83365: 0
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: UX28393
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX28393%27 HTTP/1.1" 200 None
2026-03-30 09:08:52 [auto1.it] INFO: Scrape type for UX28393: 0
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: MU61390
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: HY18936
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY18936%27 HTTP/1.1" 200 None
2026-03-30 09:08:52 [auto1.it] INFO: Scrape type for HY18936: 2
2026-03-30 09:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dc05b52-89f3-5ab7-9516-172c462a1734 with identifier: HY18936
2026-03-30 09:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dc05b52-89f3-5ab7-9516-172c462a1734 with scrape type 2
2026-03-30 09:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dc05b52-89f3-5ab7-9516-172c462a1734 with scrape type 2
2026-03-30 09:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7dc05b52-89f3-5ab7-9516-172c462a1734, identifier: HY18936
2026-03-30 09:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7dc05b52-89f3-5ab7-9516-172c462a1734 with identifier: HY18936
2026-03-30 09:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7dc05b52-89f3-5ab7-9516-172c462a1734 with identifier: HY18936
2026-03-30 09:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7dc05b52-89f3-5ab7-9516-172c462a1734 with identifier: HY18936 to the API
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:29:12Z',
 'fuel_type': 'petrol',
 'id': '7dc05b52-89f3-5ab7-9516-172c462a1734',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY18936',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 80448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-26',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2008}
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY18936%27 HTTP/1.1" 200 None
2026-03-30 09:08:52 [auto1.it] INFO: Saving data for HY18936: {'auction_closing_time': 1774884552.0, 'created_time': 1774645678.167106, 'last_price_update_time': 1774861732.501164}
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY18936') HTTP/1.1" 204 0
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: VY08559
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: PV59173
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: YU18545
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU18545%27 HTTP/1.1" 200 None
2026-03-30 09:08:52 [auto1.it] INFO: Scrape type for YU18545: 2
2026-03-30 09:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c13c9fb-03dd-5936-8592-ff8d003d3512 with identifier: YU18545
2026-03-30 09:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c13c9fb-03dd-5936-8592-ff8d003d3512 with scrape type 2
2026-03-30 09:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c13c9fb-03dd-5936-8592-ff8d003d3512 with scrape type 2
2026-03-30 09:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c13c9fb-03dd-5936-8592-ff8d003d3512, identifier: YU18545
2026-03-30 09:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c13c9fb-03dd-5936-8592-ff8d003d3512 with identifier: YU18545
2026-03-30 09:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c13c9fb-03dd-5936-8592-ff8d003d3512 with identifier: YU18545
2026-03-30 09:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c13c9fb-03dd-5936-8592-ff8d003d3512 with identifier: YU18545 to the API
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:26Z',
 'fuel_type': 'diesel',
 'id': '4c13c9fb-03dd-5936-8592-ff8d003d3512',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU18545',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 140714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-18',
 'seller_name': None,
 'title': 'Fiat Punto 1.3 JTD DPF Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2015}
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU18545%27 HTTP/1.1" 200 None
2026-03-30 09:08:52 [auto1.it] INFO: Saving data for YU18545: {'auction_closing_time': 1774884926.0, 'created_time': 1774342944.469225, 'last_price_update_time': 1774861732.935685}
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YU18545') HTTP/1.1" 204 0
2026-03-30 09:08:53 [auto1.it] INFO: Found listing with ID: UR28230
2026-03-30 09:08:53 [auto1.it] INFO: Found listing with ID: XJ39462
2026-03-30 09:08:53 [auto1.it] INFO: Found listing with ID: FN50437
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN50437%27 HTTP/1.1" 200 None
2026-03-30 09:08:53 [auto1.it] INFO: Scrape type for FN50437: 2
2026-03-30 09:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e74460d6-87f8-5b42-859a-93c7f6660117 with identifier: FN50437
2026-03-30 09:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e74460d6-87f8-5b42-859a-93c7f6660117 with scrape type 2
2026-03-30 09:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e74460d6-87f8-5b42-859a-93c7f6660117 with scrape type 2
2026-03-30 09:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e74460d6-87f8-5b42-859a-93c7f6660117, identifier: FN50437
2026-03-30 09:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e74460d6-87f8-5b42-859a-93c7f6660117 with identifier: FN50437
2026-03-30 09:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e74460d6-87f8-5b42-859a-93c7f6660117 with identifier: FN50437
2026-03-30 09:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e74460d6-87f8-5b42-859a-93c7f6660117 with identifier: FN50437 to the API
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-30T15:10:14Z',
 'fuel_type': 'hybrid',
 'id': 'e74460d6-87f8-5b42-859a-93c7f6660117',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN50437',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 294912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-12',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T8 Plug-in Hybrid R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2020}
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN50437%27 HTTP/1.1" 200 None
2026-03-30 09:08:53 [auto1.it] INFO: Saving data for FN50437: {'auction_closing_time': 1774883414.0, 'created_time': 1774559035.544163, 'last_price_update_time': 1774861733.572225}
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FN50437') HTTP/1.1" 204 0
2026-03-30 09:08:53 [auto1.it] INFO: Found listing with ID: DK87302
2026-03-30 09:08:53 [auto1.it] INFO: Found listing with ID: WD34729
2026-03-30 09:08:53 [auto1.it] INFO: Found listing with ID: HK70439
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK70439%27 HTTP/1.1" 200 None
2026-03-30 09:08:53 [auto1.it] INFO: Scrape type for HK70439: 0
2026-03-30 09:08:53 [auto1.it] INFO: Found listing with ID: EP08968
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP08968%27 HTTP/1.1" 200 None
2026-03-30 09:08:53 [auto1.it] INFO: Scrape type for EP08968: 2
2026-03-30 09:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12242d03-8542-5dea-89b9-1a22716f6df8 with identifier: EP08968
2026-03-30 09:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12242d03-8542-5dea-89b9-1a22716f6df8 with scrape type 2
2026-03-30 09:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12242d03-8542-5dea-89b9-1a22716f6df8 with scrape type 2
2026-03-30 09:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 12242d03-8542-5dea-89b9-1a22716f6df8, identifier: EP08968
2026-03-30 09:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 12242d03-8542-5dea-89b9-1a22716f6df8 with identifier: EP08968
2026-03-30 09:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 12242d03-8542-5dea-89b9-1a22716f6df8 with identifier: EP08968
2026-03-30 09:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 12242d03-8542-5dea-89b9-1a22716f6df8 with identifier: EP08968 to the API
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:44:03Z',
 'fuel_type': 'diesel',
 'id': '12242d03-8542-5dea-89b9-1a22716f6df8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP08968',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 143382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-30',
 'seller_name': None,
 'title': 'Fiat 500L 1.3 M-Jet Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2017}
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP08968%27 HTTP/1.1" 200 None
2026-03-30 09:08:54 [auto1.it] INFO: Saving data for EP08968: {'auction_closing_time': 1774885443.0, 'created_time': 1773781328.281504, 'last_price_update_time': 1774861734.013584}
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EP08968') HTTP/1.1" 204 0
2026-03-30 09:08:54 [auto1.it] INFO: Found listing with ID: EY33952
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY33952%27 HTTP/1.1" 200 None
2026-03-30 09:08:54 [auto1.it] INFO: Scrape type for EY33952: 0
2026-03-30 09:08:54 [auto1.it] INFO: Found listing with ID: LB07538
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB07538%27 HTTP/1.1" 200 None
2026-03-30 09:08:54 [auto1.it] INFO: Scrape type for LB07538: 0
2026-03-30 09:08:54 [auto1.it] INFO: Found listing with ID: KG02437
2026-03-30 09:08:54 [auto1.it] INFO: Found listing with ID: PY21369
2026-03-30 09:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:54 [auto1.it] INFO: Channel: 24h | Page: 54 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:54 [auto1.it] INFO: Found listing with ID: BE36594
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE36594%27 HTTP/1.1" 200 None
2026-03-30 09:08:54 [auto1.it] INFO: Scrape type for BE36594: 0
2026-03-30 09:08:54 [auto1.it] INFO: Found listing with ID: YH78085
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH78085%27 HTTP/1.1" 200 None
2026-03-30 09:08:54 [auto1.it] INFO: Scrape type for YH78085: 0
2026-03-30 09:08:54 [auto1.it] INFO: Found listing with ID: VM78443
2026-03-30 09:08:54 [auto1.it] INFO: Found listing with ID: LZ72377
2026-03-30 09:08:54 [auto1.it] INFO: Found listing with ID: MS56995
2026-03-30 09:08:54 [auto1.it] INFO: Found listing with ID: CS68621
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS68621%27 HTTP/1.1" 200 None
2026-03-30 09:08:54 [auto1.it] INFO: Scrape type for CS68621: 2
2026-03-30 09:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fa64abc-5990-58aa-8b7c-01b3dbb0e593 with identifier: CS68621
2026-03-30 09:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fa64abc-5990-58aa-8b7c-01b3dbb0e593 with scrape type 2
2026-03-30 09:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fa64abc-5990-58aa-8b7c-01b3dbb0e593 with scrape type 2
2026-03-30 09:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2fa64abc-5990-58aa-8b7c-01b3dbb0e593, identifier: CS68621
2026-03-30 09:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2fa64abc-5990-58aa-8b7c-01b3dbb0e593 with identifier: CS68621
2026-03-30 09:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2fa64abc-5990-58aa-8b7c-01b3dbb0e593 with identifier: CS68621
2026-03-30 09:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2fa64abc-5990-58aa-8b7c-01b3dbb0e593 with identifier: CS68621 to the API
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:40:27Z',
 'fuel_type': 'diesel',
 'id': '2fa64abc-5990-58aa-8b7c-01b3dbb0e593',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS68621',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 249321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-12',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS68621%27 HTTP/1.1" 200 None
2026-03-30 09:08:55 [auto1.it] INFO: Saving data for CS68621: {'auction_closing_time': 1774885227.0, 'created_time': 1773867627.967879, 'last_price_update_time': 1774861735.453064}
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CS68621') HTTP/1.1" 204 0
2026-03-30 09:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:55 [auto1.it] INFO: Found listing with ID: XY41121
2026-03-30 09:08:55 [auto1.it] INFO: Found listing with ID: GX81106
2026-03-30 09:08:55 [auto1.it] INFO: Found listing with ID: HG73673
2026-03-30 09:08:55 [auto1.it] INFO: Found listing with ID: GF63115
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF63115%27 HTTP/1.1" 200 None
2026-03-30 09:08:55 [auto1.it] INFO: Scrape type for GF63115: 0
2026-03-30 09:08:55 [auto1.it] INFO: Found listing with ID: HK94664
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK94664%27 HTTP/1.1" 200 None
2026-03-30 09:08:55 [auto1.it] INFO: Scrape type for HK94664: 0
2026-03-30 09:08:55 [auto1.it] INFO: Found listing with ID: PA21374
2026-03-30 09:08:55 [auto1.it] INFO: Found listing with ID: NW58325
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW58325%27 HTTP/1.1" 200 None
2026-03-30 09:08:55 [auto1.it] INFO: Scrape type for NW58325: 2
2026-03-30 09:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7108e49-4ce2-5f1e-8916-5884121580af with identifier: NW58325
2026-03-30 09:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7108e49-4ce2-5f1e-8916-5884121580af with scrape type 2
2026-03-30 09:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7108e49-4ce2-5f1e-8916-5884121580af with scrape type 2
2026-03-30 09:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d7108e49-4ce2-5f1e-8916-5884121580af, identifier: NW58325
2026-03-30 09:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d7108e49-4ce2-5f1e-8916-5884121580af with identifier: NW58325
2026-03-30 09:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d7108e49-4ce2-5f1e-8916-5884121580af with identifier: NW58325
2026-03-30 09:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d7108e49-4ce2-5f1e-8916-5884121580af with identifier: NW58325 to the API
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:27:48Z',
 'fuel_type': 'petrol',
 'id': 'd7108e49-4ce2-5f1e-8916-5884121580af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW58325',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 17362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-22',
 'seller_name': None,
 'title': 'Fiat Tipo 1.0 Tipo',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW58325%27 HTTP/1.1" 200 None
2026-03-30 09:08:56 [auto1.it] INFO: Saving data for NW58325: {'auction_closing_time': 1774884468.0, 'created_time': 1774342903.267193, 'last_price_update_time': 1774861736.278585}
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NW58325') HTTP/1.1" 204 0
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: GT90583
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT90583%27 HTTP/1.1" 200 None
2026-03-30 09:08:56 [auto1.it] INFO: Scrape type for GT90583: 2
2026-03-30 09:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c17fc6bd-14d7-5403-8637-dc8ff4de08f2 with identifier: GT90583
2026-03-30 09:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c17fc6bd-14d7-5403-8637-dc8ff4de08f2 with scrape type 2
2026-03-30 09:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c17fc6bd-14d7-5403-8637-dc8ff4de08f2 with scrape type 2
2026-03-30 09:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c17fc6bd-14d7-5403-8637-dc8ff4de08f2, identifier: GT90583
2026-03-30 09:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c17fc6bd-14d7-5403-8637-dc8ff4de08f2 with identifier: GT90583
2026-03-30 09:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c17fc6bd-14d7-5403-8637-dc8ff4de08f2 with identifier: GT90583
2026-03-30 09:08:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c17fc6bd-14d7-5403-8637-dc8ff4de08f2 with identifier: GT90583 to the API
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:45:17Z',
 'fuel_type': 'petrol',
 'id': 'c17fc6bd-14d7-5403-8637-dc8ff4de08f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT90583',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 99955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-07',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive pure',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive pure',
 'year': 2013}
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT90583%27 HTTP/1.1" 200 None
2026-03-30 09:08:56 [auto1.it] INFO: Saving data for GT90583: {'auction_closing_time': 1774885517.0, 'created_time': 1774558974.999026, 'last_price_update_time': 1774861736.69225}
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GT90583') HTTP/1.1" 204 0
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: DX18897
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: FC73004
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: ZX72389
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX72389%27 HTTP/1.1" 200 None
2026-03-30 09:08:56 [auto1.it] INFO: Scrape type for ZX72389: 0
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: EZ27389
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: LS28867
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: EZ66710
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: DP87516
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: WP21128
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP21128%27 HTTP/1.1" 200 None
2026-03-30 09:08:56 [auto1.it] INFO: Scrape type for WP21128: 0
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: DV60834
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: PS94410
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS94410%27 HTTP/1.1" 200 None
2026-03-30 09:08:56 [auto1.it] INFO: Scrape type for PS94410: 0
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: TG24306
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: TK35909
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK35909%27 HTTP/1.1" 200 None
2026-03-30 09:08:56 [auto1.it] INFO: Scrape type for TK35909: 0
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: PC99456
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: CT52714
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT52714%27 HTTP/1.1" 200 None
2026-03-30 09:08:56 [auto1.it] INFO: Scrape type for CT52714: 2
2026-03-30 09:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56bda81d-996c-5030-8803-dd56737ac2ec with identifier: CT52714
2026-03-30 09:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56bda81d-996c-5030-8803-dd56737ac2ec with scrape type 2
2026-03-30 09:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56bda81d-996c-5030-8803-dd56737ac2ec with scrape type 2
2026-03-30 09:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 56bda81d-996c-5030-8803-dd56737ac2ec, identifier: CT52714
2026-03-30 09:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 56bda81d-996c-5030-8803-dd56737ac2ec with identifier: CT52714
2026-03-30 09:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 56bda81d-996c-5030-8803-dd56737ac2ec with identifier: CT52714
2026-03-30 09:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 56bda81d-996c-5030-8803-dd56737ac2ec with identifier: CT52714 to the API
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:19:25Z',
 'fuel_type': 'diesel',
 'id': '56bda81d-996c-5030-8803-dd56737ac2ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT52714',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 235717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-25',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT52714%27 HTTP/1.1" 200 None
2026-03-30 09:08:57 [auto1.it] INFO: Saving data for CT52714: {'auction_closing_time': 1774883965.0, 'created_time': 1774559060.089316, 'last_price_update_time': 1774861737.205286}
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CT52714') HTTP/1.1" 204 0
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: JU67462
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU67462%27 HTTP/1.1" 200 None
2026-03-30 09:08:57 [auto1.it] INFO: Scrape type for JU67462: 0
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: CG84087
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG84087%27 HTTP/1.1" 200 None
2026-03-30 09:08:57 [auto1.it] INFO: Scrape type for CG84087: 0
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: VE26782
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: JU78402
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: AE85133
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE85133%27 HTTP/1.1" 200 None
2026-03-30 09:08:57 [auto1.it] INFO: Scrape type for AE85133: 0
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: UX29999
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX29999%27 HTTP/1.1" 200 None
2026-03-30 09:08:57 [auto1.it] INFO: Scrape type for UX29999: 0
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: PK65337
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK65337%27 HTTP/1.1" 200 None
2026-03-30 09:08:57 [auto1.it] INFO: Scrape type for PK65337: 0
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: CZ68446
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: UB12324
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB12324%27 HTTP/1.1" 200 None
2026-03-30 09:08:57 [auto1.it] INFO: Scrape type for UB12324: 0
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: UU69652
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: MT44233
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT44233%27 HTTP/1.1" 200 None
2026-03-30 09:08:57 [auto1.it] INFO: Scrape type for MT44233: 0
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: WH17825
2026-03-30 09:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:58 [auto1.it] INFO: Channel: 24h | Page: 55 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: UR14764
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: HR66434
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: GF05972
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: YK06699
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: JR97776
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: BE98404
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE98404%27 HTTP/1.1" 200 None
2026-03-30 09:08:58 [auto1.it] INFO: Scrape type for BE98404: 0
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: KF31033
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: FF48098
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF48098%27 HTTP/1.1" 200 None
2026-03-30 09:08:58 [auto1.it] INFO: Scrape type for FF48098: 0
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: YW01927
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW01927%27 HTTP/1.1" 200 None
2026-03-30 09:08:58 [auto1.it] INFO: Scrape type for YW01927: 2
2026-03-30 09:08:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58bd8fd4-3c25-5000-829a-c38edd565689 with identifier: YW01927
2026-03-30 09:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58bd8fd4-3c25-5000-829a-c38edd565689 with scrape type 2
2026-03-30 09:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58bd8fd4-3c25-5000-829a-c38edd565689 with scrape type 2
2026-03-30 09:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 58bd8fd4-3c25-5000-829a-c38edd565689, identifier: YW01927
2026-03-30 09:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 58bd8fd4-3c25-5000-829a-c38edd565689 with identifier: YW01927
2026-03-30 09:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 58bd8fd4-3c25-5000-829a-c38edd565689 with identifier: YW01927
2026-03-30 09:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 58bd8fd4-3c25-5000-829a-c38edd565689 with identifier: YW01927 to the API
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:56:08Z',
 'fuel_type': 'diesel',
 'id': '58bd8fd4-3c25-5000-829a-c38edd565689',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW01927',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 220721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-10',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2013}
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW01927%27 HTTP/1.1" 200 None
2026-03-30 09:08:58 [auto1.it] INFO: Saving data for YW01927: {'auction_closing_time': 1774886168.0, 'created_time': 1774645403.556525, 'last_price_update_time': 1774861738.831696}
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YW01927') HTTP/1.1" 204 0
2026-03-30 09:08:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: FT76605
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: JY35916
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: GD10861
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: JA46265
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: ET57280
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: BM81624
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM81624%27 HTTP/1.1" 200 None
2026-03-30 09:08:58 [auto1.it] INFO: Scrape type for BM81624: 0
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: WF71586
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF71586%27 HTTP/1.1" 200 None
2026-03-30 09:08:58 [auto1.it] INFO: Scrape type for WF71586: 0
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: DN99534
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: XJ23148
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: YU33914
2026-03-30 09:08:58 [auto1.it] INFO: Found listing with ID: PT53216
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT53216%27 HTTP/1.1" 200 None
2026-03-30 09:08:59 [auto1.it] INFO: Scrape type for PT53216: 0
2026-03-30 09:08:59 [auto1.it] INFO: Found listing with ID: GC53002
2026-03-30 09:08:59 [auto1.it] INFO: Found listing with ID: GJ43112
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ43112%27 HTTP/1.1" 200 None
2026-03-30 09:08:59 [auto1.it] INFO: Scrape type for GJ43112: 0
2026-03-30 09:08:59 [auto1.it] INFO: Found listing with ID: AZ52753
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ52753%27 HTTP/1.1" 200 None
2026-03-30 09:08:59 [auto1.it] INFO: Scrape type for AZ52753: 2
2026-03-30 09:08:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd0b6de0-7ad2-5995-a3c7-29ccf859b8a0 with identifier: AZ52753
2026-03-30 09:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd0b6de0-7ad2-5995-a3c7-29ccf859b8a0 with scrape type 2
2026-03-30 09:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd0b6de0-7ad2-5995-a3c7-29ccf859b8a0 with scrape type 2
2026-03-30 09:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bd0b6de0-7ad2-5995-a3c7-29ccf859b8a0, identifier: AZ52753
2026-03-30 09:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bd0b6de0-7ad2-5995-a3c7-29ccf859b8a0 with identifier: AZ52753
2026-03-30 09:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bd0b6de0-7ad2-5995-a3c7-29ccf859b8a0 with identifier: AZ52753
2026-03-30 09:08:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bd0b6de0-7ad2-5995-a3c7-29ccf859b8a0 with identifier: AZ52753 to the API
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:36:23Z',
 'fuel_type': 'diesel',
 'id': 'bd0b6de0-7ad2-5995-a3c7-29ccf859b8a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ52753',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 214077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-26',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2008}
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ52753%27 HTTP/1.1" 200 None
2026-03-30 09:09:00 [auto1.it] INFO: Saving data for AZ52753: {'auction_closing_time': 1774884983.0, 'created_time': 1773849646.719709, 'last_price_update_time': 1774861740.256785}
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AZ52753') HTTP/1.1" 204 0
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: CT25036
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT25036%27 HTTP/1.1" 200 None
2026-03-30 09:09:00 [auto1.it] INFO: Scrape type for CT25036: 0
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: FZ67880
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ67880%27 HTTP/1.1" 200 None
2026-03-30 09:09:00 [auto1.it] INFO: Scrape type for FZ67880: 0
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: VY96828
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: GA58857
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: AN61279
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: GX83807
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX83807%27 HTTP/1.1" 200 None
2026-03-30 09:09:00 [auto1.it] INFO: Scrape type for GX83807: 0
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: FL80724
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: ZT64017
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT64017%27 HTTP/1.1" 200 None
2026-03-30 09:09:00 [auto1.it] INFO: Scrape type for ZT64017: 2
2026-03-30 09:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26b3355b-3427-5877-b782-6ce18b3b4cff with identifier: ZT64017
2026-03-30 09:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b3355b-3427-5877-b782-6ce18b3b4cff with scrape type 2
2026-03-30 09:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26b3355b-3427-5877-b782-6ce18b3b4cff with scrape type 2
2026-03-30 09:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26b3355b-3427-5877-b782-6ce18b3b4cff, identifier: ZT64017
2026-03-30 09:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26b3355b-3427-5877-b782-6ce18b3b4cff with identifier: ZT64017
2026-03-30 09:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26b3355b-3427-5877-b782-6ce18b3b4cff with identifier: ZT64017
2026-03-30 09:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26b3355b-3427-5877-b782-6ce18b3b4cff with identifier: ZT64017 to the API
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:58:05Z',
 'fuel_type': 'diesel',
 'id': '26b3355b-3427-5877-b782-6ce18b3b4cff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT64017',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 205168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT64017%27 HTTP/1.1" 200 None
2026-03-30 09:09:01 [auto1.it] INFO: Saving data for ZT64017: {'auction_closing_time': 1774886285.0, 'created_time': 1773852169.990517, 'last_price_update_time': 1774861741.774497}
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZT64017') HTTP/1.1" 204 0
2026-03-30 09:09:01 [auto1.it] INFO: Found listing with ID: AB97936
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB97936%27 HTTP/1.1" 200 None
2026-03-30 09:09:01 [auto1.it] INFO: Scrape type for AB97936: 0
2026-03-30 09:09:01 [auto1.it] INFO: Found listing with ID: YL77107
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL77107%27 HTTP/1.1" 200 None
2026-03-30 09:09:01 [auto1.it] INFO: Scrape type for YL77107: 2
2026-03-30 09:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1464869b-369b-5659-a4c0-f4f6ca1d8ebe with identifier: YL77107
2026-03-30 09:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1464869b-369b-5659-a4c0-f4f6ca1d8ebe with scrape type 2
2026-03-30 09:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1464869b-369b-5659-a4c0-f4f6ca1d8ebe with scrape type 2
2026-03-30 09:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1464869b-369b-5659-a4c0-f4f6ca1d8ebe, identifier: YL77107
2026-03-30 09:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1464869b-369b-5659-a4c0-f4f6ca1d8ebe with identifier: YL77107
2026-03-30 09:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1464869b-369b-5659-a4c0-f4f6ca1d8ebe with identifier: YL77107
2026-03-30 09:09:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1464869b-369b-5659-a4c0-f4f6ca1d8ebe with identifier: YL77107 to the API
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:24:20Z',
 'fuel_type': 'diesel',
 'id': '1464869b-369b-5659-a4c0-f4f6ca1d8ebe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL77107',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 189718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-25',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL77107%27 HTTP/1.1" 200 None
2026-03-30 09:09:02 [auto1.it] INFO: Saving data for YL77107: {'auction_closing_time': 1774884260.0, 'created_time': 1774645347.806037, 'last_price_update_time': 1774861742.183898}
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YL77107') HTTP/1.1" 204 0
2026-03-30 09:09:02 [auto1.it] INFO: Found listing with ID: UW31013
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW31013%27 HTTP/1.1" 200 None
2026-03-30 09:09:02 [auto1.it] INFO: Scrape type for UW31013: 0
2026-03-30 09:09:02 [auto1.it] INFO: Found listing with ID: SN78206
2026-03-30 09:09:02 [auto1.it] INFO: Found listing with ID: AN14799
2026-03-30 09:09:02 [auto1.it] INFO: Found listing with ID: UL06285
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL06285%27 HTTP/1.1" 200 None
2026-03-30 09:09:02 [auto1.it] INFO: Scrape type for UL06285: 0
2026-03-30 09:09:02 [auto1.it] INFO: Found listing with ID: HG91847
2026-03-30 09:09:02 [auto1.it] INFO: Found listing with ID: NW69655
2026-03-30 09:09:02 [auto1.it] INFO: Found listing with ID: ER04044
2026-03-30 09:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:03 [auto1.it] INFO: Channel: 24h | Page: 56 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: ER04044
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: BJ95013
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ95013%27 HTTP/1.1" 200 None
2026-03-30 09:09:03 [auto1.it] INFO: Scrape type for BJ95013: 2
2026-03-30 09:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72c08f0c-0983-5732-b1bb-a352b34c5699 with identifier: BJ95013
2026-03-30 09:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72c08f0c-0983-5732-b1bb-a352b34c5699 with scrape type 2
2026-03-30 09:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72c08f0c-0983-5732-b1bb-a352b34c5699 with scrape type 2
2026-03-30 09:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 72c08f0c-0983-5732-b1bb-a352b34c5699, identifier: BJ95013
2026-03-30 09:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 72c08f0c-0983-5732-b1bb-a352b34c5699 with identifier: BJ95013
2026-03-30 09:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 72c08f0c-0983-5732-b1bb-a352b34c5699 with identifier: BJ95013
2026-03-30 09:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 72c08f0c-0983-5732-b1bb-a352b34c5699 with identifier: BJ95013 to the API
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:15:23Z',
 'fuel_type': 'diesel',
 'id': '72c08f0c-0983-5732-b1bb-a352b34c5699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ95013',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 37578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-18',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2023}
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ95013%27 HTTP/1.1" 200 None
2026-03-30 09:09:03 [auto1.it] INFO: Saving data for BJ95013: {'auction_closing_time': 1774883723.0, 'created_time': 1773130052.056409, 'last_price_update_time': 1774861743.549166}
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ95013') HTTP/1.1" 204 0
2026-03-30 09:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: AH48855
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH48855%27 HTTP/1.1" 200 None
2026-03-30 09:09:03 [auto1.it] INFO: Scrape type for AH48855: 0
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: EX06757
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX06757%27 HTTP/1.1" 200 None
2026-03-30 09:09:03 [auto1.it] INFO: Scrape type for EX06757: 0
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: WW83170
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW83170%27 HTTP/1.1" 200 None
2026-03-30 09:09:03 [auto1.it] INFO: Scrape type for WW83170: 0
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: HR62667
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: BJ71456
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ71456%27 HTTP/1.1" 200 None
2026-03-30 09:09:03 [auto1.it] INFO: Scrape type for BJ71456: 0
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: TN35413
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: ZG86392
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: YB89619
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB89619%27 HTTP/1.1" 200 None
2026-03-30 09:09:03 [auto1.it] INFO: Scrape type for YB89619: 0
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: PH76883
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: MJ42614
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: PZ52639
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ52639%27 HTTP/1.1" 200 None
2026-03-30 09:09:03 [auto1.it] INFO: Scrape type for PZ52639: 2
2026-03-30 09:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c22adc5e-2b66-5bb2-acb4-88dda3714007 with identifier: PZ52639
2026-03-30 09:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c22adc5e-2b66-5bb2-acb4-88dda3714007 with scrape type 2
2026-03-30 09:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c22adc5e-2b66-5bb2-acb4-88dda3714007 with scrape type 2
2026-03-30 09:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c22adc5e-2b66-5bb2-acb4-88dda3714007, identifier: PZ52639
2026-03-30 09:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c22adc5e-2b66-5bb2-acb4-88dda3714007 with identifier: PZ52639
2026-03-30 09:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c22adc5e-2b66-5bb2-acb4-88dda3714007 with identifier: PZ52639
2026-03-30 09:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c22adc5e-2b66-5bb2-acb4-88dda3714007 with identifier: PZ52639 to the API
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:59:43Z',
 'fuel_type': 'diesel',
 'id': 'c22adc5e-2b66-5bb2-acb4-88dda3714007',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ52639',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 217572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-24',
 'seller_name': None,
 'title': 'MINI One D',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ52639%27 HTTP/1.1" 200 None
2026-03-30 09:09:04 [auto1.it] INFO: Saving data for PZ52639: {'auction_closing_time': 1774886383.0, 'created_time': 1774559031.621961, 'last_price_update_time': 1774861744.205643}
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ52639') HTTP/1.1" 204 0
2026-03-30 09:09:04 [auto1.it] INFO: Found listing with ID: RB12034
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB12034%27 HTTP/1.1" 200 None
2026-03-30 09:09:04 [auto1.it] INFO: Scrape type for RB12034: 2
2026-03-30 09:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b12734c-76cb-542b-b709-3947ebcd2f2f with identifier: RB12034
2026-03-30 09:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b12734c-76cb-542b-b709-3947ebcd2f2f with scrape type 2
2026-03-30 09:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b12734c-76cb-542b-b709-3947ebcd2f2f with scrape type 2
2026-03-30 09:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1b12734c-76cb-542b-b709-3947ebcd2f2f, identifier: RB12034
2026-03-30 09:09:04 [scrapy.extensions.logstats] INFO: Crawled 288 pages (at 13 pages/min), scraped 652 items (at 95 items/min)
2026-03-30 09:09:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 198MiB
2026-03-30 09:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1b12734c-76cb-542b-b709-3947ebcd2f2f with identifier: RB12034
2026-03-30 09:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1b12734c-76cb-542b-b709-3947ebcd2f2f with identifier: RB12034
2026-03-30 09:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1b12734c-76cb-542b-b709-3947ebcd2f2f with identifier: RB12034 to the API
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:37:44Z',
 'fuel_type': 'diesel',
 'id': '1b12734c-76cb-542b-b709-3947ebcd2f2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB12034',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 86597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-31',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi Vignale',
 'transmission': 'manual',
 'trim': 'Vignale',
 'year': 2017}
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB12034%27 HTTP/1.1" 200 None
2026-03-30 09:09:04 [auto1.it] INFO: Saving data for RB12034: {'auction_closing_time': 1774885064.0, 'created_time': 1774645366.663449, 'last_price_update_time': 1774861744.804947}
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RB12034') HTTP/1.1" 204 0
2026-03-30 09:09:04 [auto1.it] INFO: Found listing with ID: PZ93737
2026-03-30 09:09:04 [auto1.it] INFO: Found listing with ID: UA37690
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA37690%27 HTTP/1.1" 200 None
2026-03-30 09:09:04 [auto1.it] INFO: Scrape type for UA37690: 0
2026-03-30 09:09:04 [auto1.it] INFO: Found listing with ID: ED77139
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED77139%27 HTTP/1.1" 200 None
2026-03-30 09:09:04 [auto1.it] INFO: Scrape type for ED77139: 0
2026-03-30 09:09:04 [auto1.it] INFO: Found listing with ID: FF45161
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF45161%27 HTTP/1.1" 200 None
2026-03-30 09:09:04 [auto1.it] INFO: Scrape type for FF45161: 0
2026-03-30 09:09:04 [auto1.it] INFO: Found listing with ID: RM13688
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM13688%27 HTTP/1.1" 200 None
2026-03-30 09:09:04 [auto1.it] INFO: Scrape type for RM13688: 2
2026-03-30 09:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c65ce2d0-5bde-523a-b2ab-a632bd8b0290 with identifier: RM13688
2026-03-30 09:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c65ce2d0-5bde-523a-b2ab-a632bd8b0290 with scrape type 2
2026-03-30 09:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c65ce2d0-5bde-523a-b2ab-a632bd8b0290 with scrape type 2
2026-03-30 09:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c65ce2d0-5bde-523a-b2ab-a632bd8b0290, identifier: RM13688
2026-03-30 09:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c65ce2d0-5bde-523a-b2ab-a632bd8b0290 with identifier: RM13688
2026-03-30 09:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c65ce2d0-5bde-523a-b2ab-a632bd8b0290 with identifier: RM13688
2026-03-30 09:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c65ce2d0-5bde-523a-b2ab-a632bd8b0290 with identifier: RM13688 to the API
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:55:07Z',
 'fuel_type': 'diesel',
 'id': 'c65ce2d0-5bde-523a-b2ab-a632bd8b0290',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM13688',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 108326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-20',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2020}
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM13688%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Saving data for RM13688: {'auction_closing_time': 1774886107.0, 'created_time': 1774267301.732798, 'last_price_update_time': 1774861745.278634}
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RM13688') HTTP/1.1" 204 0
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: KU06425
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU06425%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Scrape type for KU06425: 0
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: GV49335
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: ZL07806
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: XG74352
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: JV69341
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV69341%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Scrape type for JV69341: 0
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: AZ64167
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: JR54731
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: EH51725
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: BD88975
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: SK38422
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK38422%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Scrape type for SK38422: 0
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: YW35893
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: TG42626
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: MP39083
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: WN42286
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: XB00155
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: UZ24825
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: XX37698
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX37698%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Scrape type for XX37698: 0
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: PL52224
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL52224%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Scrape type for PL52224: 0
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: DU17366
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU17366%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Scrape type for DU17366: 0
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: YG69242
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG69242%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Scrape type for YG69242: 2
2026-03-30 09:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 461b2ce0-c306-5ab1-9a9e-16d2f8b219b3 with identifier: YG69242
2026-03-30 09:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 461b2ce0-c306-5ab1-9a9e-16d2f8b219b3 with scrape type 2
2026-03-30 09:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 461b2ce0-c306-5ab1-9a9e-16d2f8b219b3 with scrape type 2
2026-03-30 09:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 461b2ce0-c306-5ab1-9a9e-16d2f8b219b3, identifier: YG69242
2026-03-30 09:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 461b2ce0-c306-5ab1-9a9e-16d2f8b219b3 with identifier: YG69242
2026-03-30 09:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 461b2ce0-c306-5ab1-9a9e-16d2f8b219b3 with identifier: YG69242
2026-03-30 09:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 461b2ce0-c306-5ab1-9a9e-16d2f8b219b3 with identifier: YG69242 to the API
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:16:59Z',
 'fuel_type': 'petrol',
 'id': '461b2ce0-c306-5ab1-9a9e-16d2f8b219b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG69242',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 295529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-03',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2009}
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG69242%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Saving data for YG69242: {'auction_closing_time': 1774883819.0, 'created_time': 1774559080.524079, 'last_price_update_time': 1774861745.79768}
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YG69242') HTTP/1.1" 204 0
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: WT33776
2026-03-30 09:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:10 [auto1.it] INFO: Channel: 24h | Page: 57 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:10 [auto1.it] INFO: Found listing with ID: JH67201
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH67201%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [auto1.it] INFO: Scrape type for JH67201: 0
2026-03-30 09:09:11 [auto1.it] INFO: Found listing with ID: JU08968
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU08968%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [auto1.it] INFO: Scrape type for JU08968: 0
2026-03-30 09:09:11 [auto1.it] INFO: Found listing with ID: RG08940
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG08940%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [auto1.it] INFO: Scrape type for RG08940: 2
2026-03-30 09:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3e7b393-fcfa-5493-9ce1-8ceb3c2cb91b with identifier: RG08940
2026-03-30 09:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3e7b393-fcfa-5493-9ce1-8ceb3c2cb91b with scrape type 2
2026-03-30 09:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3e7b393-fcfa-5493-9ce1-8ceb3c2cb91b with scrape type 2
2026-03-30 09:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b3e7b393-fcfa-5493-9ce1-8ceb3c2cb91b, identifier: RG08940
2026-03-30 09:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b3e7b393-fcfa-5493-9ce1-8ceb3c2cb91b with identifier: RG08940
2026-03-30 09:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b3e7b393-fcfa-5493-9ce1-8ceb3c2cb91b with identifier: RG08940
2026-03-30 09:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b3e7b393-fcfa-5493-9ce1-8ceb3c2cb91b with identifier: RG08940 to the API
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:37Z',
 'fuel_type': 'diesel',
 'id': 'b3e7b393-fcfa-5493-9ce1-8ceb3c2cb91b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG08940',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 44949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-22',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG08940%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [auto1.it] INFO: Saving data for RG08940: {'auction_closing_time': 1774884577.0, 'created_time': 1774645684.839364, 'last_price_update_time': 1774861751.390735}
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG08940') HTTP/1.1" 204 0
2026-03-30 09:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:11 [auto1.it] INFO: Found listing with ID: PM46324
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM46324%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [auto1.it] INFO: Scrape type for PM46324: 0
2026-03-30 09:09:11 [auto1.it] INFO: Found listing with ID: KZ30481
2026-03-30 09:09:11 [auto1.it] INFO: Found listing with ID: RS22306
2026-03-30 09:09:11 [auto1.it] INFO: Found listing with ID: JD45338
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD45338%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [auto1.it] INFO: Scrape type for JD45338: 2
2026-03-30 09:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2665f07-a82f-5279-ab47-57c8e135f777 with identifier: JD45338
2026-03-30 09:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2665f07-a82f-5279-ab47-57c8e135f777 with scrape type 2
2026-03-30 09:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2665f07-a82f-5279-ab47-57c8e135f777 with scrape type 2
2026-03-30 09:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b2665f07-a82f-5279-ab47-57c8e135f777, identifier: JD45338
2026-03-30 09:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b2665f07-a82f-5279-ab47-57c8e135f777 with identifier: JD45338
2026-03-30 09:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b2665f07-a82f-5279-ab47-57c8e135f777 with identifier: JD45338
2026-03-30 09:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b2665f07-a82f-5279-ab47-57c8e135f777 with identifier: JD45338 to the API
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:04:00Z',
 'fuel_type': 'diesel',
 'id': 'b2665f07-a82f-5279-ab47-57c8e135f777',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD45338',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 120862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-17',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2019}
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD45338%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [auto1.it] INFO: Saving data for JD45338: {'auction_closing_time': 1774883040.0, 'created_time': 1774645660.12374, 'last_price_update_time': 1774861751.807737}
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JD45338') HTTP/1.1" 204 0
2026-03-30 09:09:11 [auto1.it] INFO: Found listing with ID: RU70753
2026-03-30 09:09:11 [auto1.it] INFO: Found listing with ID: NP16593
2026-03-30 09:09:11 [auto1.it] INFO: Found listing with ID: JT23346
2026-03-30 09:09:11 [auto1.it] INFO: Found listing with ID: RB23819
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB23819%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [auto1.it] INFO: Scrape type for RB23819: 0
2026-03-30 09:09:11 [auto1.it] INFO: Found listing with ID: AW98600
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW98600%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [auto1.it] INFO: Scrape type for AW98600: 2
2026-03-30 09:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f908b4d1-cd72-5496-8876-74f4b50b337a with identifier: AW98600
2026-03-30 09:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f908b4d1-cd72-5496-8876-74f4b50b337a with scrape type 2
2026-03-30 09:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f908b4d1-cd72-5496-8876-74f4b50b337a with scrape type 2
2026-03-30 09:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f908b4d1-cd72-5496-8876-74f4b50b337a, identifier: AW98600
2026-03-30 09:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f908b4d1-cd72-5496-8876-74f4b50b337a with identifier: AW98600
2026-03-30 09:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f908b4d1-cd72-5496-8876-74f4b50b337a with identifier: AW98600
2026-03-30 09:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f908b4d1-cd72-5496-8876-74f4b50b337a with identifier: AW98600 to the API
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'diesel',
 'id': 'f908b4d1-cd72-5496-8876-74f4b50b337a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW98600',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 133290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-04',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Evolve',
 'transmission': 'manual',
 'trim': 'Evolve',
 'year': 2017}
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW98600%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [auto1.it] INFO: Saving data for AW98600: {'auction_closing_time': 1774882938.0, 'created_time': 1773759792.118343, 'last_price_update_time': 1774861752.230867}
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AW98600') HTTP/1.1" 204 0
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: ZC00549
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC00549%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [auto1.it] INFO: Scrape type for ZC00549: 2
2026-03-30 09:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18b2b1a8-e035-5119-a8f2-f2b99738da62 with identifier: ZC00549
2026-03-30 09:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18b2b1a8-e035-5119-a8f2-f2b99738da62 with scrape type 2
2026-03-30 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18b2b1a8-e035-5119-a8f2-f2b99738da62 with scrape type 2
2026-03-30 09:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18b2b1a8-e035-5119-a8f2-f2b99738da62, identifier: ZC00549
2026-03-30 09:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18b2b1a8-e035-5119-a8f2-f2b99738da62 with identifier: ZC00549
2026-03-30 09:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18b2b1a8-e035-5119-a8f2-f2b99738da62 with identifier: ZC00549
2026-03-30 09:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18b2b1a8-e035-5119-a8f2-f2b99738da62 with identifier: ZC00549 to the API
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:42:27Z',
 'fuel_type': 'petrol',
 'id': '18b2b1a8-e035-5119-a8f2-f2b99738da62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC00549',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 166466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-26',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC00549%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [auto1.it] INFO: Saving data for ZC00549: {'auction_closing_time': 1774885347.0, 'created_time': 1774558868.260741, 'last_price_update_time': 1774861752.733896}
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZC00549') HTTP/1.1" 204 0
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: TJ20772
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: KB15233
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB15233%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [auto1.it] INFO: Scrape type for KB15233: 0
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: ML96661
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML96661%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [auto1.it] INFO: Scrape type for ML96661: 0
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: AR12639
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR12639%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [auto1.it] INFO: Scrape type for AR12639: 0
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: JM76846
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: DX27899
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX27899%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [auto1.it] INFO: Scrape type for DX27899: 0
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: UT67830
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: RU27646
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: UE02945
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE02945%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [auto1.it] INFO: Scrape type for UE02945: 0
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: XY73038
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY73038%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [auto1.it] INFO: Scrape type for XY73038: 0
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: WM78801
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: TZ26377
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: RJ37840
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: VM43481
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM43481%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [auto1.it] INFO: Scrape type for VM43481: 2
2026-03-30 09:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49e888e6-e08b-55b6-b9f8-fdb6743794c4 with identifier: VM43481
2026-03-30 09:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4 with scrape type 2
2026-03-30 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4 with scrape type 2
2026-03-30 09:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49e888e6-e08b-55b6-b9f8-fdb6743794c4, identifier: VM43481
2026-03-30 09:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49e888e6-e08b-55b6-b9f8-fdb6743794c4 with identifier: VM43481
2026-03-30 09:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49e888e6-e08b-55b6-b9f8-fdb6743794c4 with identifier: VM43481
2026-03-30 09:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49e888e6-e08b-55b6-b9f8-fdb6743794c4 with identifier: VM43481 to the API
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:49:58Z',
 'fuel_type': 'hybrid',
 'id': '49e888e6-e08b-55b6-b9f8-fdb6743794c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM43481',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 44141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-26',
 'seller_name': None,
 'title': 'BMW X2 xDrive 25e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2022}
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM43481%27 HTTP/1.1" 200 None
2026-03-30 09:09:13 [auto1.it] INFO: Saving data for VM43481: {'auction_closing_time': 1774885798.0, 'created_time': 1773824515.890056, 'last_price_update_time': 1774861753.365083}
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VM43481') HTTP/1.1" 204 0
2026-03-30 09:09:13 [auto1.it] INFO: Found listing with ID: FL08980
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL08980%27 HTTP/1.1" 200 None
2026-03-30 09:09:13 [auto1.it] INFO: Scrape type for FL08980: 2
2026-03-30 09:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a380435-8274-5744-991b-9ee45a57966b with identifier: FL08980
2026-03-30 09:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a380435-8274-5744-991b-9ee45a57966b with scrape type 2
2026-03-30 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a380435-8274-5744-991b-9ee45a57966b with scrape type 2
2026-03-30 09:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a380435-8274-5744-991b-9ee45a57966b, identifier: FL08980
2026-03-30 09:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a380435-8274-5744-991b-9ee45a57966b with identifier: FL08980
2026-03-30 09:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a380435-8274-5744-991b-9ee45a57966b with identifier: FL08980
2026-03-30 09:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a380435-8274-5744-991b-9ee45a57966b with identifier: FL08980 to the API
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 262,
 'expiration_date': '2026-03-30T15:12:24Z',
 'fuel_type': 'diesel',
 'id': '6a380435-8274-5744-991b-9ee45a57966b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL08980',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 130655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion Terrain Tech',
 'transmission': 'automatic',
 'trim': 'BlueMotion Terrain Tech',
 'year': 2015}
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL08980%27 HTTP/1.1" 200 None
2026-03-30 09:09:13 [auto1.it] INFO: Saving data for FL08980: {'auction_closing_time': 1774883544.0, 'created_time': 1774645690.898581, 'last_price_update_time': 1774861753.907899}
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FL08980') HTTP/1.1" 204 0
2026-03-30 09:09:13 [auto1.it] INFO: Found listing with ID: EG41470
2026-03-30 09:09:13 [auto1.it] INFO: Found listing with ID: HL58093
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL58093%27 HTTP/1.1" 200 None
2026-03-30 09:09:13 [auto1.it] INFO: Scrape type for HL58093: 2
2026-03-30 09:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32946ab-cf3c-5c98-97c7-b06ed7d8e463 with identifier: HL58093
2026-03-30 09:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32946ab-cf3c-5c98-97c7-b06ed7d8e463 with scrape type 2
2026-03-30 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c32946ab-cf3c-5c98-97c7-b06ed7d8e463 with scrape type 2
2026-03-30 09:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c32946ab-cf3c-5c98-97c7-b06ed7d8e463, identifier: HL58093
2026-03-30 09:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c32946ab-cf3c-5c98-97c7-b06ed7d8e463 with identifier: HL58093
2026-03-30 09:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c32946ab-cf3c-5c98-97c7-b06ed7d8e463 with identifier: HL58093
2026-03-30 09:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c32946ab-cf3c-5c98-97c7-b06ed7d8e463 with identifier: HL58093 to the API
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:32:48Z',
 'fuel_type': 'petrol',
 'id': 'c32946ab-cf3c-5c98-97c7-b06ed7d8e463',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL58093',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 18529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-17',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 SCe Streetway Access',
 'transmission': 'manual',
 'trim': 'Streetway Access',
 'year': 2019}
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL58093%27 HTTP/1.1" 200 None
2026-03-30 09:09:14 [auto1.it] INFO: Saving data for HL58093: {'auction_closing_time': 1774884768.0, 'created_time': 1774083637.219989, 'last_price_update_time': 1774861754.336896}
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HL58093') HTTP/1.1" 204 0
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: TZ47815
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ47815%27 HTTP/1.1" 200 None
2026-03-30 09:09:14 [auto1.it] INFO: Scrape type for TZ47815: 0
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: ST20254
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST20254%27 HTTP/1.1" 200 None
2026-03-30 09:09:14 [auto1.it] INFO: Scrape type for ST20254: 0
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: BB73520
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB73520%27 HTTP/1.1" 200 None
2026-03-30 09:09:14 [auto1.it] INFO: Scrape type for BB73520: 0
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: XJ82802
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ82802%27 HTTP/1.1" 200 None
2026-03-30 09:09:14 [auto1.it] INFO: Scrape type for XJ82802: 2
2026-03-30 09:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0702c44-4415-525e-9f2b-2a5dd6e30af7 with identifier: XJ82802
2026-03-30 09:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0702c44-4415-525e-9f2b-2a5dd6e30af7 with scrape type 2
2026-03-30 09:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0702c44-4415-525e-9f2b-2a5dd6e30af7 with scrape type 2
2026-03-30 09:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a0702c44-4415-525e-9f2b-2a5dd6e30af7, identifier: XJ82802
2026-03-30 09:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a0702c44-4415-525e-9f2b-2a5dd6e30af7 with identifier: XJ82802
2026-03-30 09:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a0702c44-4415-525e-9f2b-2a5dd6e30af7 with identifier: XJ82802
2026-03-30 09:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a0702c44-4415-525e-9f2b-2a5dd6e30af7 with identifier: XJ82802 to the API
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:29:19Z',
 'fuel_type': 'petrol',
 'id': 'a0702c44-4415-525e-9f2b-2a5dd6e30af7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ82802',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 128959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-12-28',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ82802%27 HTTP/1.1" 200 None
2026-03-30 09:09:14 [auto1.it] INFO: Saving data for XJ82802: {'auction_closing_time': 1774884559.0, 'created_time': 1774558835.94758, 'last_price_update_time': 1774861754.795855}
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XJ82802') HTTP/1.1" 204 0
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: WK74495
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK74495%27 HTTP/1.1" 200 None
2026-03-30 09:09:14 [auto1.it] INFO: Scrape type for WK74495: 0
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: ZM35614
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: VC06734
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: YY46039
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: CV81447
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV81447%27 HTTP/1.1" 200 None
2026-03-30 09:09:14 [auto1.it] INFO: Scrape type for CV81447: 0
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: MD08971
2026-03-30 09:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:15 [auto1.it] INFO: Channel: 24h | Page: 58 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:15 [auto1.it] INFO: Found listing with ID: XN19179
2026-03-30 09:09:15 [auto1.it] INFO: Found listing with ID: YU91907
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU91907%27 HTTP/1.1" 200 None
2026-03-30 09:09:15 [auto1.it] INFO: Scrape type for YU91907: 2
2026-03-30 09:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e75e820d-40b2-5c8d-8c44-f4f05eaa4838 with identifier: YU91907
2026-03-30 09:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e75e820d-40b2-5c8d-8c44-f4f05eaa4838 with scrape type 2
2026-03-30 09:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e75e820d-40b2-5c8d-8c44-f4f05eaa4838 with scrape type 2
2026-03-30 09:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e75e820d-40b2-5c8d-8c44-f4f05eaa4838, identifier: YU91907
2026-03-30 09:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e75e820d-40b2-5c8d-8c44-f4f05eaa4838 with identifier: YU91907
2026-03-30 09:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e75e820d-40b2-5c8d-8c44-f4f05eaa4838 with identifier: YU91907
2026-03-30 09:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e75e820d-40b2-5c8d-8c44-f4f05eaa4838 with identifier: YU91907 to the API
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:08:05Z',
 'fuel_type': 'petrol',
 'id': 'e75e820d-40b2-5c8d-8c44-f4f05eaa4838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU91907',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 66883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-19',
 'seller_name': None,
 'title': 'Fiat 500X 1.5 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU91907%27 HTTP/1.1" 200 None
2026-03-30 09:09:16 [auto1.it] INFO: Saving data for YU91907: {'auction_closing_time': 1774883285.0, 'created_time': 1774645560.720052, 'last_price_update_time': 1774861756.155531}
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YU91907') HTTP/1.1" 204 0
2026-03-30 09:09:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: JJ50665
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: KY69981
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: HN39146
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: MG67619
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: YA22905
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: YG30728
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG30728%27 HTTP/1.1" 200 None
2026-03-30 09:09:16 [auto1.it] INFO: Scrape type for YG30728: 0
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: PU63843
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: SW30840
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: LK86303
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK86303%27 HTTP/1.1" 200 None
2026-03-30 09:09:16 [auto1.it] INFO: Scrape type for LK86303: 2
2026-03-30 09:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77a39a52-ce7b-52e7-a0c0-dfb62d4df3e5 with identifier: LK86303
2026-03-30 09:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77a39a52-ce7b-52e7-a0c0-dfb62d4df3e5 with scrape type 2
2026-03-30 09:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77a39a52-ce7b-52e7-a0c0-dfb62d4df3e5 with scrape type 2
2026-03-30 09:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 77a39a52-ce7b-52e7-a0c0-dfb62d4df3e5, identifier: LK86303
2026-03-30 09:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 77a39a52-ce7b-52e7-a0c0-dfb62d4df3e5 with identifier: LK86303
2026-03-30 09:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 77a39a52-ce7b-52e7-a0c0-dfb62d4df3e5 with identifier: LK86303
2026-03-30 09:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 77a39a52-ce7b-52e7-a0c0-dfb62d4df3e5 with identifier: LK86303 to the API
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:22:40Z',
 'fuel_type': 'diesel',
 'id': '77a39a52-ce7b-52e7-a0c0-dfb62d4df3e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK86303',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 149562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-15',
 'seller_name': None,
 'title': 'Fiat Tipo 1.3 M-Jet Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2017}
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK86303%27 HTTP/1.1" 200 None
2026-03-30 09:09:16 [auto1.it] INFO: Saving data for LK86303: {'auction_closing_time': 1774884160.0, 'created_time': 1774645681.670736, 'last_price_update_time': 1774861756.96116}
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LK86303') HTTP/1.1" 204 0
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: LX64348
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: CG66796
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG66796%27 HTTP/1.1" 200 None
2026-03-30 09:09:16 [auto1.it] INFO: Scrape type for CG66796: 0
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: UK17345
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK17345%27 HTTP/1.1" 200 None
2026-03-30 09:09:17 [auto1.it] INFO: Scrape type for UK17345: 2
2026-03-30 09:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50cb5db1-55f8-5b16-bbda-c025ff361a83 with identifier: UK17345
2026-03-30 09:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50cb5db1-55f8-5b16-bbda-c025ff361a83 with scrape type 2
2026-03-30 09:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50cb5db1-55f8-5b16-bbda-c025ff361a83 with scrape type 2
2026-03-30 09:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 50cb5db1-55f8-5b16-bbda-c025ff361a83, identifier: UK17345
2026-03-30 09:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 50cb5db1-55f8-5b16-bbda-c025ff361a83 with identifier: UK17345
2026-03-30 09:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 50cb5db1-55f8-5b16-bbda-c025ff361a83 with identifier: UK17345
2026-03-30 09:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 50cb5db1-55f8-5b16-bbda-c025ff361a83 with identifier: UK17345 to the API
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:34:30Z',
 'fuel_type': 'diesel',
 'id': '50cb5db1-55f8-5b16-bbda-c025ff361a83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK17345',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 145615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-03',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK17345%27 HTTP/1.1" 200 None
2026-03-30 09:09:17 [auto1.it] INFO: Saving data for UK17345: {'auction_closing_time': 1774884870.0, 'created_time': 1773327960.684735, 'last_price_update_time': 1774861757.697375}
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UK17345') HTTP/1.1" 204 0
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: ZP08653
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: WU48456
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU48456%27 HTTP/1.1" 200 None
2026-03-30 09:09:17 [auto1.it] INFO: Scrape type for WU48456: 0
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: WW68303
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: LT86375
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: PG53512
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: RK63045
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: SB68054
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB68054%27 HTTP/1.1" 200 None
2026-03-30 09:09:17 [auto1.it] INFO: Scrape type for SB68054: 0
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: NF38082
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: BE98345
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE98345%27 HTTP/1.1" 200 None
2026-03-30 09:09:17 [auto1.it] INFO: Scrape type for BE98345: 2
2026-03-30 09:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a810e5d-7500-5ae4-a52f-1edebfb99bd3 with identifier: BE98345
2026-03-30 09:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a810e5d-7500-5ae4-a52f-1edebfb99bd3 with scrape type 2
2026-03-30 09:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a810e5d-7500-5ae4-a52f-1edebfb99bd3 with scrape type 2
2026-03-30 09:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1a810e5d-7500-5ae4-a52f-1edebfb99bd3, identifier: BE98345
2026-03-30 09:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1a810e5d-7500-5ae4-a52f-1edebfb99bd3 with identifier: BE98345
2026-03-30 09:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1a810e5d-7500-5ae4-a52f-1edebfb99bd3 with identifier: BE98345
2026-03-30 09:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1a810e5d-7500-5ae4-a52f-1edebfb99bd3 with identifier: BE98345 to the API
2026-03-30 09:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:21:06Z',
 'fuel_type': 'petrol',
 'id': '1a810e5d-7500-5ae4-a52f-1edebfb99bd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE98345',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 57279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-24',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Confort',
 'transmission': 'automatic',
 'trim': 'Confort',
 'year': 2009}
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE98345%27 HTTP/1.1" 200 None
2026-03-30 09:09:19 [auto1.it] INFO: Saving data for BE98345: {'auction_closing_time': 1774884066.0, 'created_time': 1774645599.291039, 'last_price_update_time': 1774861759.497272}
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BE98345') HTTP/1.1" 204 0
2026-03-30 09:09:19 [auto1.it] INFO: Found listing with ID: YB60466
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB60466%27 HTTP/1.1" 200 None
2026-03-30 09:09:19 [auto1.it] INFO: Scrape type for YB60466: 0
2026-03-30 09:09:19 [auto1.it] INFO: Found listing with ID: RA25408
2026-03-30 09:09:19 [auto1.it] INFO: Found listing with ID: YB05417
2026-03-30 09:09:19 [auto1.it] INFO: Found listing with ID: AF81201
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF81201%27 HTTP/1.1" 200 None
2026-03-30 09:09:19 [auto1.it] INFO: Scrape type for AF81201: 0
2026-03-30 09:09:19 [auto1.it] INFO: Found listing with ID: PT68883
2026-03-30 09:09:19 [auto1.it] INFO: Found listing with ID: YH73900
2026-03-30 09:09:19 [auto1.it] INFO: Found listing with ID: XC56824
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC56824%27 HTTP/1.1" 200 None
2026-03-30 09:09:19 [auto1.it] INFO: Scrape type for XC56824: 0
2026-03-30 09:09:19 [auto1.it] INFO: Found listing with ID: LH69939
2026-03-30 09:09:19 [auto1.it] INFO: Found listing with ID: FA93618
2026-03-30 09:09:19 [auto1.it] INFO: Found listing with ID: LD48805
2026-03-30 09:09:19 [auto1.it] INFO: Found listing with ID: GR86359
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR86359%27 HTTP/1.1" 200 None
2026-03-30 09:09:19 [auto1.it] INFO: Scrape type for GR86359: 2
2026-03-30 09:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b9aa534-d7df-54b4-b0b2-3fb080b92ed4 with identifier: GR86359
2026-03-30 09:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b9aa534-d7df-54b4-b0b2-3fb080b92ed4 with scrape type 2
2026-03-30 09:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b9aa534-d7df-54b4-b0b2-3fb080b92ed4 with scrape type 2
2026-03-30 09:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1b9aa534-d7df-54b4-b0b2-3fb080b92ed4, identifier: GR86359
2026-03-30 09:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1b9aa534-d7df-54b4-b0b2-3fb080b92ed4 with identifier: GR86359
2026-03-30 09:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1b9aa534-d7df-54b4-b0b2-3fb080b92ed4 with identifier: GR86359
2026-03-30 09:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1b9aa534-d7df-54b4-b0b2-3fb080b92ed4 with identifier: GR86359 to the API
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 152,
 'expiration_date': '2026-03-30T15:54:04Z',
 'fuel_type': 'diesel',
 'id': '1b9aa534-d7df-54b4-b0b2-3fb080b92ed4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR86359',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Freelander',
 'odometer': 219621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-19',
 'seller_name': None,
 'title': 'Land Rover Freelander 2.2 Td4 HSE',
 'transmission': 'manual',
 'trim': 'HSE',
 'year': 2008}
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR86359%27 HTTP/1.1" 200 None
2026-03-30 09:09:20 [auto1.it] INFO: Saving data for GR86359: {'auction_closing_time': 1774886044.0, 'created_time': 1773129789.077306, 'last_price_update_time': 1774861760.477975}
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GR86359') HTTP/1.1" 204 0
2026-03-30 09:09:20 [auto1.it] INFO: Found listing with ID: BR14904
2026-03-30 09:09:20 [auto1.it] INFO: Found listing with ID: HX42058
2026-03-30 09:09:20 [auto1.it] INFO: Found listing with ID: BN39787
2026-03-30 09:09:20 [auto1.it] INFO: Found listing with ID: LZ05951
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ05951%27 HTTP/1.1" 200 None
2026-03-30 09:09:20 [auto1.it] INFO: Scrape type for LZ05951: 2
2026-03-30 09:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc8dcf41-73bb-50d1-bbb1-70e783bb295b with identifier: LZ05951
2026-03-30 09:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc8dcf41-73bb-50d1-bbb1-70e783bb295b with scrape type 2
2026-03-30 09:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc8dcf41-73bb-50d1-bbb1-70e783bb295b with scrape type 2
2026-03-30 09:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bc8dcf41-73bb-50d1-bbb1-70e783bb295b, identifier: LZ05951
2026-03-30 09:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bc8dcf41-73bb-50d1-bbb1-70e783bb295b with identifier: LZ05951
2026-03-30 09:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bc8dcf41-73bb-50d1-bbb1-70e783bb295b with identifier: LZ05951
2026-03-30 09:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bc8dcf41-73bb-50d1-bbb1-70e783bb295b with identifier: LZ05951 to the API
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:30Z',
 'fuel_type': 'diesel',
 'id': 'bc8dcf41-73bb-50d1-bbb1-70e783bb295b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ05951',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 71735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-20',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2019}
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ05951%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Saving data for LZ05951: {'auction_closing_time': 1774884630.0, 'created_time': 1773328065.984043, 'last_price_update_time': 1774861761.047432}
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LZ05951') HTTP/1.1" 204 0
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: HC78741
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC78741%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Scrape type for HC78741: 0
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: FX50490
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX50490%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Scrape type for FX50490: 0
2026-03-30 09:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:21 [auto1.it] INFO: Channel: 24h | Page: 59 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: DU09881
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU09881%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Scrape type for DU09881: 2
2026-03-30 09:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83acac5e-b59c-5eb6-9fee-21b5918068ca with identifier: DU09881
2026-03-30 09:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83acac5e-b59c-5eb6-9fee-21b5918068ca with scrape type 2
2026-03-30 09:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83acac5e-b59c-5eb6-9fee-21b5918068ca with scrape type 2
2026-03-30 09:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 83acac5e-b59c-5eb6-9fee-21b5918068ca, identifier: DU09881
2026-03-30 09:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 83acac5e-b59c-5eb6-9fee-21b5918068ca with identifier: DU09881
2026-03-30 09:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 83acac5e-b59c-5eb6-9fee-21b5918068ca with identifier: DU09881
2026-03-30 09:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 83acac5e-b59c-5eb6-9fee-21b5918068ca with identifier: DU09881 to the API
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:57:35Z',
 'fuel_type': 'petrol',
 'id': '83acac5e-b59c-5eb6-9fee-21b5918068ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU09881',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 144527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-29',
 'seller_name': None,
 'title': 'Peugeot 208 1.0 VTi Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2015}
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU09881%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Saving data for DU09881: {'auction_closing_time': 1774886255.0, 'created_time': 1774645685.844225, 'last_price_update_time': 1774861761.808421}
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DU09881') HTTP/1.1" 204 0
2026-03-30 09:09:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: EF98667
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF98667%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Scrape type for EF98667: 0
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: SR46685
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR46685%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Scrape type for SR46685: 0
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: TA87203
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: DW89993
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: TB60435
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: GM11383
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM11383%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Scrape type for GM11383: 0
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: ZJ09783
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: GG79286
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: KC12001
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC12001%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Scrape type for KC12001: 0
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: NB15044
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB15044%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Scrape type for NB15044: 0
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: VG33831
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: SL84548
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: FP61129
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP61129%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Scrape type for FP61129: 0
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: ZV75074
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: JZ46948
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: DZ84756
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: GU38190
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU38190%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Scrape type for GU38190: 2
2026-03-30 09:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4d6a0fd-6aab-5c87-81a3-d8705ace02aa with identifier: GU38190
2026-03-30 09:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4d6a0fd-6aab-5c87-81a3-d8705ace02aa with scrape type 2
2026-03-30 09:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4d6a0fd-6aab-5c87-81a3-d8705ace02aa with scrape type 2
2026-03-30 09:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4d6a0fd-6aab-5c87-81a3-d8705ace02aa, identifier: GU38190
2026-03-30 09:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4d6a0fd-6aab-5c87-81a3-d8705ace02aa with identifier: GU38190
2026-03-30 09:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4d6a0fd-6aab-5c87-81a3-d8705ace02aa with identifier: GU38190
2026-03-30 09:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4d6a0fd-6aab-5c87-81a3-d8705ace02aa with identifier: GU38190 to the API
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:10:24Z',
 'fuel_type': 'petrol',
 'id': 'd4d6a0fd-6aab-5c87-81a3-d8705ace02aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU38190',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 70223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2014}
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU38190%27 HTTP/1.1" 200 None
2026-03-30 09:09:22 [auto1.it] INFO: Saving data for GU38190: {'auction_closing_time': 1774883424.0, 'created_time': 1774645386.354792, 'last_price_update_time': 1774861762.324851}
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GU38190') HTTP/1.1" 204 0
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: CF35894
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF35894%27 HTTP/1.1" 200 None
2026-03-30 09:09:22 [auto1.it] INFO: Scrape type for CF35894: 0
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: DC62247
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: KD87590
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: VY00315
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY00315%27 HTTP/1.1" 200 None
2026-03-30 09:09:22 [auto1.it] INFO: Scrape type for VY00315: 2
2026-03-30 09:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e8d9262-0624-5b35-9bd0-0f3465dbfc57 with identifier: VY00315
2026-03-30 09:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e8d9262-0624-5b35-9bd0-0f3465dbfc57 with scrape type 2
2026-03-30 09:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e8d9262-0624-5b35-9bd0-0f3465dbfc57 with scrape type 2
2026-03-30 09:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7e8d9262-0624-5b35-9bd0-0f3465dbfc57, identifier: VY00315
2026-03-30 09:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7e8d9262-0624-5b35-9bd0-0f3465dbfc57 with identifier: VY00315
2026-03-30 09:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7e8d9262-0624-5b35-9bd0-0f3465dbfc57 with identifier: VY00315
2026-03-30 09:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7e8d9262-0624-5b35-9bd0-0f3465dbfc57 with identifier: VY00315 to the API
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:51:19Z',
 'fuel_type': 'petrol',
 'id': '7e8d9262-0624-5b35-9bd0-0f3465dbfc57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY00315',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 108792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-31',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.2 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2011}
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY00315%27 HTTP/1.1" 200 None
2026-03-30 09:09:22 [auto1.it] INFO: Saving data for VY00315: {'auction_closing_time': 1774885879.0, 'created_time': 1774559077.154231, 'last_price_update_time': 1774861762.887068}
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY00315') HTTP/1.1" 204 0
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: JH32473
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: VG76075
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: HW82018
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: KA98059
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: UB96617
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB96617%27 HTTP/1.1" 200 None
2026-03-30 09:09:22 [auto1.it] INFO: Scrape type for UB96617: 0
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: FL87170
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: RF11851
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: HC78855
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: VF62325
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF62325%27 HTTP/1.1" 200 None
2026-03-30 09:09:22 [auto1.it] INFO: Scrape type for VF62325: 0
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: NU40150
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: KT00361
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: HA02667
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: ZF04289
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: NC40954
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC40954%27 HTTP/1.1" 200 None
2026-03-30 09:09:22 [auto1.it] INFO: Scrape type for NC40954: 2
2026-03-30 09:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83aa5120-ee65-5331-9e3c-7b1f08372446 with identifier: NC40954
2026-03-30 09:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83aa5120-ee65-5331-9e3c-7b1f08372446 with scrape type 2
2026-03-30 09:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83aa5120-ee65-5331-9e3c-7b1f08372446 with scrape type 2
2026-03-30 09:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 83aa5120-ee65-5331-9e3c-7b1f08372446, identifier: NC40954
2026-03-30 09:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 83aa5120-ee65-5331-9e3c-7b1f08372446 with identifier: NC40954
2026-03-30 09:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 83aa5120-ee65-5331-9e3c-7b1f08372446 with identifier: NC40954
2026-03-30 09:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 83aa5120-ee65-5331-9e3c-7b1f08372446 with identifier: NC40954 to the API
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-30T15:30:09Z',
 'fuel_type': 'diesel',
 'id': '83aa5120-ee65-5331-9e3c-7b1f08372446',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC40954',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Defender',
 'odometer': 166387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-07',
 'seller_name': None,
 'title': 'Land Rover Defender D250 Mild-Hybrid 110 S',
 'transmission': 'automatic',
 'trim': '110 S',
 'year': 2021}
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC40954%27 HTTP/1.1" 200 None
2026-03-30 09:09:23 [auto1.it] INFO: Saving data for NC40954: {'auction_closing_time': 1774884609.0, 'created_time': 1773139705.37998, 'last_price_update_time': 1774861763.387001}
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NC40954') HTTP/1.1" 204 0
2026-03-30 09:09:23 [auto1.it] INFO: Found listing with ID: UZ24263
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ24263%27 HTTP/1.1" 200 None
2026-03-30 09:09:23 [auto1.it] INFO: Scrape type for UZ24263: 0
2026-03-30 09:09:23 [auto1.it] INFO: Found listing with ID: LY33062
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY33062%27 HTTP/1.1" 200 None
2026-03-30 09:09:23 [auto1.it] INFO: Scrape type for LY33062: 0
2026-03-30 09:09:23 [auto1.it] INFO: Found listing with ID: WF98355
2026-03-30 09:09:23 [auto1.it] INFO: Found listing with ID: RY75551
2026-03-30 09:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:24 [auto1.it] INFO: Channel: 24h | Page: 60 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:24 [auto1.it] INFO: Found listing with ID: GT17174
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT17174%27 HTTP/1.1" 200 None
2026-03-30 09:09:24 [auto1.it] INFO: Scrape type for GT17174: 0
2026-03-30 09:09:24 [auto1.it] INFO: Found listing with ID: PW10693
2026-03-30 09:09:24 [auto1.it] INFO: Found listing with ID: RV11940
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV11940%27 HTTP/1.1" 200 None
2026-03-30 09:09:24 [auto1.it] INFO: Scrape type for RV11940: 0
2026-03-30 09:09:24 [auto1.it] INFO: Found listing with ID: RA84354
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA84354%27 HTTP/1.1" 200 None
2026-03-30 09:09:24 [auto1.it] INFO: Scrape type for RA84354: 0
2026-03-30 09:09:24 [auto1.it] INFO: Found listing with ID: CC08861
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC08861%27 HTTP/1.1" 200 None
2026-03-30 09:09:24 [auto1.it] INFO: Scrape type for CC08861: 2
2026-03-30 09:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce124878-1064-5af3-aa60-b32357b2dc08 with identifier: CC08861
2026-03-30 09:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce124878-1064-5af3-aa60-b32357b2dc08 with scrape type 2
2026-03-30 09:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce124878-1064-5af3-aa60-b32357b2dc08 with scrape type 2
2026-03-30 09:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ce124878-1064-5af3-aa60-b32357b2dc08, identifier: CC08861
2026-03-30 09:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ce124878-1064-5af3-aa60-b32357b2dc08 with identifier: CC08861
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 09:09:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ce124878-1064-5af3-aa60-b32357b2dc08 with identifier: CC08861
2026-03-30 09:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ce124878-1064-5af3-aa60-b32357b2dc08 with identifier: CC08861 to the API
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:32:23Z',
 'fuel_type': 'petrol',
 'id': 'ce124878-1064-5af3-aa60-b32357b2dc08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC08861',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 96853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-31',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Elefantino',
 'transmission': 'manual',
 'trim': 'Elefantino',
 'year': 2014}
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC08861%27 HTTP/1.1" 200 None
2026-03-30 09:09:24 [auto1.it] INFO: Saving data for CC08861: {'auction_closing_time': 1774884743.0, 'created_time': 1774584041.936088, 'last_price_update_time': 1774861764.960142}
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CC08861') HTTP/1.1" 204 0
2026-03-30 09:09:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:24 [auto1.it] INFO: Found listing with ID: SP14530
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP14530%27 HTTP/1.1" 200 None
2026-03-30 09:09:24 [auto1.it] INFO: Scrape type for SP14530: 0
2026-03-30 09:09:24 [auto1.it] INFO: Found listing with ID: TH32608
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH32608%27 HTTP/1.1" 200 None
2026-03-30 09:09:25 [auto1.it] INFO: Scrape type for TH32608: 2
2026-03-30 09:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 488e6df5-58f5-5b89-a57d-833f8a86bff2 with identifier: TH32608
2026-03-30 09:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 488e6df5-58f5-5b89-a57d-833f8a86bff2 with scrape type 2
2026-03-30 09:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 488e6df5-58f5-5b89-a57d-833f8a86bff2 with scrape type 2
2026-03-30 09:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 488e6df5-58f5-5b89-a57d-833f8a86bff2, identifier: TH32608
2026-03-30 09:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 488e6df5-58f5-5b89-a57d-833f8a86bff2 with identifier: TH32608
2026-03-30 09:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 488e6df5-58f5-5b89-a57d-833f8a86bff2 with identifier: TH32608
2026-03-30 09:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 488e6df5-58f5-5b89-a57d-833f8a86bff2 with identifier: TH32608 to the API
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:30:36Z',
 'fuel_type': 'diesel',
 'id': '488e6df5-58f5-5b89-a57d-833f8a86bff2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH32608',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 178545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-21',
 'seller_name': None,
 'title': 'BMW X1 sDrive 16d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH32608%27 HTTP/1.1" 200 None
2026-03-30 09:09:25 [auto1.it] INFO: Saving data for TH32608: {'auction_closing_time': 1774884636.0, 'created_time': 1774558855.041096, 'last_price_update_time': 1774861765.384163}
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TH32608') HTTP/1.1" 204 0
2026-03-30 09:09:25 [auto1.it] INFO: Found listing with ID: WH70643
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH70643%27 HTTP/1.1" 200 None
2026-03-30 09:09:25 [auto1.it] INFO: Scrape type for WH70643: 0
2026-03-30 09:09:25 [auto1.it] INFO: Found listing with ID: ZJ87985
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ87985%27 HTTP/1.1" 200 None
2026-03-30 09:09:25 [auto1.it] INFO: Scrape type for ZJ87985: 2
2026-03-30 09:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7691557d-5545-5b54-9600-42d92b81ad93 with identifier: ZJ87985
2026-03-30 09:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7691557d-5545-5b54-9600-42d92b81ad93 with scrape type 2
2026-03-30 09:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7691557d-5545-5b54-9600-42d92b81ad93 with scrape type 2
2026-03-30 09:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7691557d-5545-5b54-9600-42d92b81ad93, identifier: ZJ87985
2026-03-30 09:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7691557d-5545-5b54-9600-42d92b81ad93 with identifier: ZJ87985
2026-03-30 09:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7691557d-5545-5b54-9600-42d92b81ad93 with identifier: ZJ87985
2026-03-30 09:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7691557d-5545-5b54-9600-42d92b81ad93 with identifier: ZJ87985 to the API
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:44:48Z',
 'fuel_type': 'petrol',
 'id': '7691557d-5545-5b54-9600-42d92b81ad93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ87985',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 38859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2021}
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ87985%27 HTTP/1.1" 200 None
2026-03-30 09:09:26 [auto1.it] INFO: Saving data for ZJ87985: {'auction_closing_time': 1774885488.0, 'created_time': 1774342865.263392, 'last_price_update_time': 1774861766.162939}
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZJ87985') HTTP/1.1" 204 0
2026-03-30 09:09:26 [auto1.it] INFO: Found listing with ID: RF43689
2026-03-30 09:09:26 [auto1.it] INFO: Found listing with ID: BV06574
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV06574%27 HTTP/1.1" 200 None
2026-03-30 09:09:26 [auto1.it] INFO: Scrape type for BV06574: 0
2026-03-30 09:09:26 [auto1.it] INFO: Found listing with ID: US24028
2026-03-30 09:09:26 [auto1.it] INFO: Found listing with ID: AS07739
2026-03-30 09:09:26 [auto1.it] INFO: Found listing with ID: DC13549
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC13549%27 HTTP/1.1" 200 None
2026-03-30 09:09:26 [auto1.it] INFO: Scrape type for DC13549: 2
2026-03-30 09:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11661f40-9607-5fe8-a19d-6cf85ad53920 with identifier: DC13549
2026-03-30 09:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11661f40-9607-5fe8-a19d-6cf85ad53920 with scrape type 2
2026-03-30 09:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11661f40-9607-5fe8-a19d-6cf85ad53920 with scrape type 2
2026-03-30 09:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 11661f40-9607-5fe8-a19d-6cf85ad53920, identifier: DC13549
2026-03-30 09:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 11661f40-9607-5fe8-a19d-6cf85ad53920 with identifier: DC13549
2026-03-30 09:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 11661f40-9607-5fe8-a19d-6cf85ad53920 with identifier: DC13549
2026-03-30 09:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 11661f40-9607-5fe8-a19d-6cf85ad53920 with identifier: DC13549 to the API
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:40:25Z',
 'fuel_type': 'diesel',
 'id': '11661f40-9607-5fe8-a19d-6cf85ad53920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC13549',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 131259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-10',
 'seller_name': None,
 'title': 'Audi A4 Allroad 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC13549%27 HTTP/1.1" 200 None
2026-03-30 09:09:26 [auto1.it] INFO: Saving data for DC13549: {'auction_closing_time': 1774885225.0, 'created_time': 1774645615.756558, 'last_price_update_time': 1774861766.700808}
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DC13549') HTTP/1.1" 204 0
2026-03-30 09:09:26 [auto1.it] INFO: Found listing with ID: DW68997
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW68997%27 HTTP/1.1" 200 None
2026-03-30 09:09:26 [auto1.it] INFO: Scrape type for DW68997: 0
2026-03-30 09:09:26 [auto1.it] INFO: Found listing with ID: VB18666
2026-03-30 09:09:26 [auto1.it] INFO: Found listing with ID: YT14284
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT14284%27 HTTP/1.1" 200 None
2026-03-30 09:09:26 [auto1.it] INFO: Scrape type for YT14284: 2
2026-03-30 09:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b649c2f-8398-5fdc-9091-789e3e85f13b with identifier: YT14284
2026-03-30 09:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b649c2f-8398-5fdc-9091-789e3e85f13b with scrape type 2
2026-03-30 09:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b649c2f-8398-5fdc-9091-789e3e85f13b with scrape type 2
2026-03-30 09:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2b649c2f-8398-5fdc-9091-789e3e85f13b, identifier: YT14284
2026-03-30 09:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2b649c2f-8398-5fdc-9091-789e3e85f13b with identifier: YT14284
2026-03-30 09:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2b649c2f-8398-5fdc-9091-789e3e85f13b with identifier: YT14284
2026-03-30 09:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2b649c2f-8398-5fdc-9091-789e3e85f13b with identifier: YT14284 to the API
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:31:53Z',
 'fuel_type': 'petrol',
 'id': '2b649c2f-8398-5fdc-9091-789e3e85f13b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT14284',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 184194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-26',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2019}
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT14284%27 HTTP/1.1" 200 None
2026-03-30 09:09:27 [auto1.it] INFO: Saving data for YT14284: {'auction_closing_time': 1774884713.0, 'created_time': 1774267392.673427, 'last_price_update_time': 1774861767.576122}
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YT14284') HTTP/1.1" 204 0
2026-03-30 09:09:27 [auto1.it] INFO: Found listing with ID: ND31908
2026-03-30 09:09:27 [auto1.it] INFO: Found listing with ID: XJ18858
2026-03-30 09:09:27 [auto1.it] INFO: Found listing with ID: NP40750
2026-03-30 09:09:27 [auto1.it] INFO: Found listing with ID: RS54948
2026-03-30 09:09:27 [auto1.it] INFO: Found listing with ID: UP03227
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP03227%27 HTTP/1.1" 200 None
2026-03-30 09:09:27 [auto1.it] INFO: Scrape type for UP03227: 0
2026-03-30 09:09:27 [auto1.it] INFO: Found listing with ID: ZK89803
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK89803%27 HTTP/1.1" 200 None
2026-03-30 09:09:27 [auto1.it] INFO: Scrape type for ZK89803: 2
2026-03-30 09:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ecefbef-ddf0-5029-80e4-0fdecd33e32a with identifier: ZK89803
2026-03-30 09:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ecefbef-ddf0-5029-80e4-0fdecd33e32a with scrape type 2
2026-03-30 09:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ecefbef-ddf0-5029-80e4-0fdecd33e32a with scrape type 2
2026-03-30 09:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3ecefbef-ddf0-5029-80e4-0fdecd33e32a, identifier: ZK89803
2026-03-30 09:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3ecefbef-ddf0-5029-80e4-0fdecd33e32a with identifier: ZK89803
2026-03-30 09:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3ecefbef-ddf0-5029-80e4-0fdecd33e32a with identifier: ZK89803
2026-03-30 09:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3ecefbef-ddf0-5029-80e4-0fdecd33e32a with identifier: ZK89803 to the API
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:42:53Z',
 'fuel_type': 'petrol',
 'id': '3ecefbef-ddf0-5029-80e4-0fdecd33e32a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK89803',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 242651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-10',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK89803%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [auto1.it] INFO: Saving data for ZK89803: {'auction_closing_time': 1774885373.0, 'created_time': 1774559031.952761, 'last_price_update_time': 1774861768.053425}
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZK89803') HTTP/1.1" 204 0
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: MY00561
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY00561%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [auto1.it] INFO: Scrape type for MY00561: 0
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: XJ13084
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: VT42722
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: VD09142
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD09142%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [auto1.it] INFO: Scrape type for VD09142: 0
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: VP48054
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: FU99331
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: DS02463
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: WL66559
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: JW95602
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW95602%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [auto1.it] INFO: Scrape type for JW95602: 0
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: ZE21394
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: JF95895
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: KM59258
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: ZU06634
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU06634%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [auto1.it] INFO: Scrape type for ZU06634: 0
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: DT24064
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: RM50913
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM50913%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [auto1.it] INFO: Scrape type for RM50913: 2
2026-03-30 09:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf9f91c1-acb4-5d19-a1ad-dc3b10fd6108 with identifier: RM50913
2026-03-30 09:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf9f91c1-acb4-5d19-a1ad-dc3b10fd6108 with scrape type 2
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf9f91c1-acb4-5d19-a1ad-dc3b10fd6108 with scrape type 2
2026-03-30 09:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf9f91c1-acb4-5d19-a1ad-dc3b10fd6108, identifier: RM50913
2026-03-30 09:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf9f91c1-acb4-5d19-a1ad-dc3b10fd6108 with identifier: RM50913
2026-03-30 09:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf9f91c1-acb4-5d19-a1ad-dc3b10fd6108 with identifier: RM50913
2026-03-30 09:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf9f91c1-acb4-5d19-a1ad-dc3b10fd6108 with identifier: RM50913 to the API
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:25:28Z',
 'fuel_type': 'diesel',
 'id': 'bf9f91c1-acb4-5d19-a1ad-dc3b10fd6108',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM50913',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 114278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-21',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM50913%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [auto1.it] INFO: Saving data for RM50913: {'auction_closing_time': 1774884328.0, 'created_time': 1772308870.833215, 'last_price_update_time': 1774861768.66151}
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RM50913') HTTP/1.1" 204 0
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: CY97706
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY97706%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [auto1.it] INFO: Scrape type for CY97706: 0
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: TY61219
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY61219%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [auto1.it] INFO: Scrape type for TY61219: 2
2026-03-30 09:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa567efe-2cc7-5cc7-b9db-262ec7d4caaa with identifier: TY61219
2026-03-30 09:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa567efe-2cc7-5cc7-b9db-262ec7d4caaa with scrape type 2
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa567efe-2cc7-5cc7-b9db-262ec7d4caaa with scrape type 2
2026-03-30 09:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa567efe-2cc7-5cc7-b9db-262ec7d4caaa, identifier: TY61219
2026-03-30 09:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa567efe-2cc7-5cc7-b9db-262ec7d4caaa with identifier: TY61219
2026-03-30 09:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa567efe-2cc7-5cc7-b9db-262ec7d4caaa with identifier: TY61219
2026-03-30 09:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa567efe-2cc7-5cc7-b9db-262ec7d4caaa with identifier: TY61219 to the API
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:14:16Z',
 'fuel_type': 'diesel',
 'id': 'fa567efe-2cc7-5cc7-b9db-262ec7d4caaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY61219',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 147122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-14',
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Class 2WD',
 'transmission': 'manual',
 'trim': 'Class 2WD',
 'year': 2013}
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY61219%27 HTTP/1.1" 200 None
2026-03-30 09:09:29 [auto1.it] INFO: Saving data for TY61219: {'auction_closing_time': 1774883656.0, 'created_time': 1774645674.981026, 'last_price_update_time': 1774861769.220003}
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TY61219') HTTP/1.1" 204 0
2026-03-30 09:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:29 [auto1.it] INFO: Channel: 24h | Page: 61 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:29 [auto1.it] INFO: Found listing with ID: VV63992
2026-03-30 09:09:29 [auto1.it] INFO: Found listing with ID: DD55036
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD55036%27 HTTP/1.1" 200 None
2026-03-30 09:09:29 [auto1.it] INFO: Scrape type for DD55036: 2
2026-03-30 09:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b5ea524-2203-5a60-93e2-bd4e7534c3a0 with identifier: DD55036
2026-03-30 09:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b5ea524-2203-5a60-93e2-bd4e7534c3a0 with scrape type 2
2026-03-30 09:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b5ea524-2203-5a60-93e2-bd4e7534c3a0 with scrape type 2
2026-03-30 09:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b5ea524-2203-5a60-93e2-bd4e7534c3a0, identifier: DD55036
2026-03-30 09:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b5ea524-2203-5a60-93e2-bd4e7534c3a0 with identifier: DD55036
2026-03-30 09:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b5ea524-2203-5a60-93e2-bd4e7534c3a0 with identifier: DD55036
2026-03-30 09:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b5ea524-2203-5a60-93e2-bd4e7534c3a0 with identifier: DD55036 to the API
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:20:42Z',
 'fuel_type': 'petrol',
 'id': '6b5ea524-2203-5a60-93e2-bd4e7534c3a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD55036',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 204468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-28',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Urban Move',
 'transmission': 'manual',
 'trim': 'Urban Move',
 'year': 2009}
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD55036%27 HTTP/1.1" 200 None
2026-03-30 09:09:30 [auto1.it] INFO: Saving data for DD55036: {'auction_closing_time': 1774884042.0, 'created_time': 1773759739.005607, 'last_price_update_time': 1774861770.461127}
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DD55036') HTTP/1.1" 204 0
2026-03-30 09:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:30 [auto1.it] INFO: Found listing with ID: PM10461
2026-03-30 09:09:30 [auto1.it] INFO: Found listing with ID: JN19530
2026-03-30 09:09:30 [auto1.it] INFO: Found listing with ID: FS34329
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS34329%27 HTTP/1.1" 200 None
2026-03-30 09:09:30 [auto1.it] INFO: Scrape type for FS34329: 0
2026-03-30 09:09:30 [auto1.it] INFO: Found listing with ID: PV13410
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV13410%27 HTTP/1.1" 200 None
2026-03-30 09:09:30 [auto1.it] INFO: Scrape type for PV13410: 0
2026-03-30 09:09:30 [auto1.it] INFO: Found listing with ID: AV12122
2026-03-30 09:09:30 [auto1.it] INFO: Found listing with ID: ZZ56254
2026-03-30 09:09:30 [auto1.it] INFO: Found listing with ID: UN43339
2026-03-30 09:09:30 [auto1.it] INFO: Found listing with ID: PV39557
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV39557%27 HTTP/1.1" 200 None
2026-03-30 09:09:30 [auto1.it] INFO: Scrape type for PV39557: 2
2026-03-30 09:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc02e662-5873-5699-9807-4fce97929c5b with identifier: PV39557
2026-03-30 09:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc02e662-5873-5699-9807-4fce97929c5b with scrape type 2
2026-03-30 09:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc02e662-5873-5699-9807-4fce97929c5b with scrape type 2
2026-03-30 09:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dc02e662-5873-5699-9807-4fce97929c5b, identifier: PV39557
2026-03-30 09:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dc02e662-5873-5699-9807-4fce97929c5b with identifier: PV39557
2026-03-30 09:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dc02e662-5873-5699-9807-4fce97929c5b with identifier: PV39557
2026-03-30 09:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dc02e662-5873-5699-9807-4fce97929c5b with identifier: PV39557 to the API
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 126,
 'expiration_date': '2026-03-30T15:23:04Z',
 'fuel_type': 'petrol',
 'id': 'dc02e662-5873-5699-9807-4fce97929c5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV39557',
 'listing': 'auction',
 'make': 'EVO',
 'model': '5',
 'odometer': 17553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-26',
 'seller_name': None,
 'title': 'EVO 5 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2024}
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV39557%27 HTTP/1.1" 200 None
2026-03-30 09:09:31 [auto1.it] INFO: Saving data for PV39557: {'auction_closing_time': 1774884184.0, 'created_time': 1774267417.00299, 'last_price_update_time': 1774861771.423047}
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PV39557') HTTP/1.1" 204 0
2026-03-30 09:09:31 [auto1.it] INFO: Found listing with ID: ZE71737
2026-03-30 09:09:31 [auto1.it] INFO: Found listing with ID: FP75199
2026-03-30 09:09:31 [auto1.it] INFO: Found listing with ID: HH07211
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH07211%27 HTTP/1.1" 200 None
2026-03-30 09:09:31 [auto1.it] INFO: Scrape type for HH07211: 2
2026-03-30 09:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fc2a24c-2c30-5ab7-9725-bad43f159140 with identifier: HH07211
2026-03-30 09:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc2a24c-2c30-5ab7-9725-bad43f159140 with scrape type 2
2026-03-30 09:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fc2a24c-2c30-5ab7-9725-bad43f159140 with scrape type 2
2026-03-30 09:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0fc2a24c-2c30-5ab7-9725-bad43f159140, identifier: HH07211
2026-03-30 09:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0fc2a24c-2c30-5ab7-9725-bad43f159140 with identifier: HH07211
2026-03-30 09:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0fc2a24c-2c30-5ab7-9725-bad43f159140 with identifier: HH07211
2026-03-30 09:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0fc2a24c-2c30-5ab7-9725-bad43f159140 with identifier: HH07211 to the API
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:24Z',
 'fuel_type': 'diesel',
 'id': '0fc2a24c-2c30-5ab7-9725-bad43f159140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH07211',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 206695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-29',
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH07211%27 HTTP/1.1" 200 None
2026-03-30 09:09:32 [auto1.it] INFO: Saving data for HH07211: {'auction_closing_time': 1774883484.0, 'created_time': 1774559058.535771, 'last_price_update_time': 1774861772.027357}
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HH07211') HTTP/1.1" 204 0
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: FY46493
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: GJ95983
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ95983%27 HTTP/1.1" 200 None
2026-03-30 09:09:32 [auto1.it] INFO: Scrape type for GJ95983: 0
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: NZ40909
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: AF82865
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: LG18660
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: SE98453
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE98453%27 HTTP/1.1" 200 None
2026-03-30 09:09:32 [auto1.it] INFO: Scrape type for SE98453: 0
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: TJ64738
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ64738%27 HTTP/1.1" 200 None
2026-03-30 09:09:32 [auto1.it] INFO: Scrape type for TJ64738: 0
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: UB44414
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB44414%27 HTTP/1.1" 200 None
2026-03-30 09:09:32 [auto1.it] INFO: Scrape type for UB44414: 2
2026-03-30 09:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59c451b5-1c76-546c-a35d-be3a779c15f3 with identifier: UB44414
2026-03-30 09:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59c451b5-1c76-546c-a35d-be3a779c15f3 with scrape type 2
2026-03-30 09:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59c451b5-1c76-546c-a35d-be3a779c15f3 with scrape type 2
2026-03-30 09:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 59c451b5-1c76-546c-a35d-be3a779c15f3, identifier: UB44414
2026-03-30 09:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 59c451b5-1c76-546c-a35d-be3a779c15f3 with identifier: UB44414
2026-03-30 09:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 59c451b5-1c76-546c-a35d-be3a779c15f3 with identifier: UB44414
2026-03-30 09:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 59c451b5-1c76-546c-a35d-be3a779c15f3 with identifier: UB44414 to the API
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:50:16Z',
 'fuel_type': 'petrol',
 'id': '59c451b5-1c76-546c-a35d-be3a779c15f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB44414',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 271641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-11',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Dynamique Ecobusiness',
 'transmission': 'manual',
 'trim': 'Dynamique Ecobusiness',
 'year': 2011}
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB44414%27 HTTP/1.1" 200 None
2026-03-30 09:09:32 [auto1.it] INFO: Saving data for UB44414: {'auction_closing_time': 1774885816.0, 'created_time': 1774559025.26448, 'last_price_update_time': 1774861772.483014}
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB44414') HTTP/1.1" 204 0
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: EU82988
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: SM22245
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM22245%27 HTTP/1.1" 200 None
2026-03-30 09:09:32 [auto1.it] INFO: Scrape type for SM22245: 0
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: LD41720
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD41720%27 HTTP/1.1" 200 None
2026-03-30 09:09:32 [auto1.it] INFO: Scrape type for LD41720: 0
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: DL42775
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: DP88225
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP88225%27 HTTP/1.1" 200 None
2026-03-30 09:09:32 [auto1.it] INFO: Scrape type for DP88225: 2
2026-03-30 09:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e74d4799-865d-5300-b4a5-e13001587d90 with identifier: DP88225
2026-03-30 09:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e74d4799-865d-5300-b4a5-e13001587d90 with scrape type 2
2026-03-30 09:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e74d4799-865d-5300-b4a5-e13001587d90 with scrape type 2
2026-03-30 09:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e74d4799-865d-5300-b4a5-e13001587d90, identifier: DP88225
2026-03-30 09:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e74d4799-865d-5300-b4a5-e13001587d90 with identifier: DP88225
2026-03-30 09:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e74d4799-865d-5300-b4a5-e13001587d90 with identifier: DP88225
2026-03-30 09:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e74d4799-865d-5300-b4a5-e13001587d90 with identifier: DP88225 to the API
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:08:18Z',
 'fuel_type': 'petrol',
 'id': 'e74d4799-865d-5300-b4a5-e13001587d90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP88225',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 142262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turbo Progression',
 'transmission': 'manual',
 'trim': 'Progression',
 'year': 2015}
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP88225%27 HTTP/1.1" 200 None
2026-03-30 09:09:33 [auto1.it] INFO: Saving data for DP88225: {'auction_closing_time': 1774883298.0, 'created_time': 1773137887.819754, 'last_price_update_time': 1774861773.042254}
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP88225') HTTP/1.1" 204 0
2026-03-30 09:09:33 [auto1.it] INFO: Found listing with ID: JJ49663
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ49663%27 HTTP/1.1" 200 None
2026-03-30 09:09:33 [auto1.it] INFO: Scrape type for JJ49663: 2
2026-03-30 09:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9267b30b-f70c-5f65-95e0-a640f15453a1 with identifier: JJ49663
2026-03-30 09:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9267b30b-f70c-5f65-95e0-a640f15453a1 with scrape type 2
2026-03-30 09:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9267b30b-f70c-5f65-95e0-a640f15453a1 with scrape type 2
2026-03-30 09:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9267b30b-f70c-5f65-95e0-a640f15453a1, identifier: JJ49663
2026-03-30 09:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9267b30b-f70c-5f65-95e0-a640f15453a1 with identifier: JJ49663
2026-03-30 09:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9267b30b-f70c-5f65-95e0-a640f15453a1 with identifier: JJ49663
2026-03-30 09:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9267b30b-f70c-5f65-95e0-a640f15453a1 with identifier: JJ49663 to the API
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:29:09Z',
 'fuel_type': 'diesel',
 'id': '9267b30b-f70c-5f65-95e0-a640f15453a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ49663',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Alfa 159',
 'odometer': 386196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-14',
 'seller_name': None,
 'title': 'Alfa Romeo Alfa 159 2.0 JTDM',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ49663%27 HTTP/1.1" 200 None
2026-03-30 09:09:33 [auto1.it] INFO: Saving data for JJ49663: {'auction_closing_time': 1774884549.0, 'created_time': 1774645386.824975, 'last_price_update_time': 1774861773.454015}
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JJ49663') HTTP/1.1" 204 0
2026-03-30 09:09:33 [auto1.it] INFO: Found listing with ID: GV75261
2026-03-30 09:09:33 [auto1.it] INFO: Found listing with ID: LZ50355
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ50355%27 HTTP/1.1" 200 None
2026-03-30 09:09:33 [auto1.it] INFO: Scrape type for LZ50355: 0
2026-03-30 09:09:33 [auto1.it] INFO: Found listing with ID: TA75240
2026-03-30 09:09:33 [auto1.it] INFO: Found listing with ID: DB04877
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB04877%27 HTTP/1.1" 200 None
2026-03-30 09:09:33 [auto1.it] INFO: Scrape type for DB04877: 2
2026-03-30 09:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a48fb272-2298-5d2f-9069-8d3c97f48f61 with identifier: DB04877
2026-03-30 09:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a48fb272-2298-5d2f-9069-8d3c97f48f61 with scrape type 2
2026-03-30 09:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a48fb272-2298-5d2f-9069-8d3c97f48f61 with scrape type 2
2026-03-30 09:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a48fb272-2298-5d2f-9069-8d3c97f48f61, identifier: DB04877
2026-03-30 09:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a48fb272-2298-5d2f-9069-8d3c97f48f61 with identifier: DB04877
2026-03-30 09:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a48fb272-2298-5d2f-9069-8d3c97f48f61 with identifier: DB04877
2026-03-30 09:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a48fb272-2298-5d2f-9069-8d3c97f48f61 with identifier: DB04877 to the API
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:46:05Z',
 'fuel_type': 'diesel',
 'id': 'a48fb272-2298-5d2f-9069-8d3c97f48f61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB04877',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 240835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB04877%27 HTTP/1.1" 200 None
2026-03-30 09:09:33 [auto1.it] INFO: Saving data for DB04877: {'auction_closing_time': 1774885565.0, 'created_time': 1774645575.570529, 'last_price_update_time': 1774861773.878588}
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DB04877') HTTP/1.1" 204 0
2026-03-30 09:09:33 [auto1.it] INFO: Found listing with ID: XV39349
2026-03-30 09:09:33 [auto1.it] INFO: Found listing with ID: CN31542
2026-03-30 09:09:33 [auto1.it] INFO: Found listing with ID: BV97691
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV97691%27 HTTP/1.1" 200 None
2026-03-30 09:09:33 [auto1.it] INFO: Scrape type for BV97691: 2
2026-03-30 09:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd1c825-6cfb-5036-9ad2-bf414ad1bfef with identifier: BV97691
2026-03-30 09:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd1c825-6cfb-5036-9ad2-bf414ad1bfef with scrape type 2
2026-03-30 09:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fd1c825-6cfb-5036-9ad2-bf414ad1bfef with scrape type 2
2026-03-30 09:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7fd1c825-6cfb-5036-9ad2-bf414ad1bfef, identifier: BV97691
2026-03-30 09:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7fd1c825-6cfb-5036-9ad2-bf414ad1bfef with identifier: BV97691
2026-03-30 09:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7fd1c825-6cfb-5036-9ad2-bf414ad1bfef with identifier: BV97691
2026-03-30 09:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7fd1c825-6cfb-5036-9ad2-bf414ad1bfef with identifier: BV97691 to the API
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:17:07Z',
 'fuel_type': 'diesel',
 'id': '7fd1c825-6cfb-5036-9ad2-bf414ad1bfef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV97691',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 242081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-21',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2016}
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV97691%27 HTTP/1.1" 200 None
2026-03-30 09:09:34 [auto1.it] INFO: Saving data for BV97691: {'auction_closing_time': 1774883827.0, 'created_time': 1774559035.165036, 'last_price_update_time': 1774861774.316818}
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BV97691') HTTP/1.1" 204 0
2026-03-30 09:09:34 [auto1.it] INFO: Found listing with ID: UA89499
2026-03-30 09:09:34 [auto1.it] INFO: Found listing with ID: HZ93936
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ93936%27 HTTP/1.1" 200 None
2026-03-30 09:09:34 [auto1.it] INFO: Scrape type for HZ93936: 0
2026-03-30 09:09:34 [auto1.it] INFO: Found listing with ID: LV04843
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV04843%27 HTTP/1.1" 200 None
2026-03-30 09:09:34 [auto1.it] INFO: Scrape type for LV04843: 0
2026-03-30 09:09:34 [auto1.it] INFO: Found listing with ID: WA74830
2026-03-30 09:09:34 [auto1.it] INFO: Found listing with ID: FS29770
2026-03-30 09:09:34 [auto1.it] INFO: Found listing with ID: KD78044
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD78044%27 HTTP/1.1" 200 None
2026-03-30 09:09:34 [auto1.it] INFO: Scrape type for KD78044: 0
2026-03-30 09:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:34 [auto1.it] INFO: Channel: 24h | Page: 62 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:34 [auto1.it] INFO: Found listing with ID: LG36476
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG36476%27 HTTP/1.1" 200 None
2026-03-30 09:09:34 [auto1.it] INFO: Scrape type for LG36476: 2
2026-03-30 09:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c307dc86-ff42-5d8b-b27a-17d7f8885e02 with identifier: LG36476
2026-03-30 09:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c307dc86-ff42-5d8b-b27a-17d7f8885e02 with scrape type 2
2026-03-30 09:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c307dc86-ff42-5d8b-b27a-17d7f8885e02 with scrape type 2
2026-03-30 09:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c307dc86-ff42-5d8b-b27a-17d7f8885e02, identifier: LG36476
2026-03-30 09:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c307dc86-ff42-5d8b-b27a-17d7f8885e02 with identifier: LG36476
2026-03-30 09:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c307dc86-ff42-5d8b-b27a-17d7f8885e02 with identifier: LG36476
2026-03-30 09:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c307dc86-ff42-5d8b-b27a-17d7f8885e02 with identifier: LG36476 to the API
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:29:23Z',
 'fuel_type': 'diesel',
 'id': 'c307dc86-ff42-5d8b-b27a-17d7f8885e02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG36476',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 188902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2011}
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG36476%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Saving data for LG36476: {'auction_closing_time': 1774884563.0, 'created_time': 1773136054.197557, 'last_price_update_time': 1774861775.03118}
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG36476') HTTP/1.1" 204 0
2026-03-30 09:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: BY06123
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY06123%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for BY06123: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: TD31675
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: DV58522
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: TV19217
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV19217%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for TV19217: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: UB21320
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB21320%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for UB21320: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: HD69394
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: PM68240
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM68240%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for PM68240: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: CH03473
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: TE47770
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: BZ06099
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: SS52204
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: PT89621
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT89621%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for PT89621: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: HX75119
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX75119%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for HX75119: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: ZL28386
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL28386%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for ZL28386: 2
2026-03-30 09:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 201ace3f-a3d9-54ef-a0a1-f5df8b827770 with identifier: ZL28386
2026-03-30 09:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 201ace3f-a3d9-54ef-a0a1-f5df8b827770 with scrape type 2
2026-03-30 09:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 201ace3f-a3d9-54ef-a0a1-f5df8b827770 with scrape type 2
2026-03-30 09:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 201ace3f-a3d9-54ef-a0a1-f5df8b827770, identifier: ZL28386
2026-03-30 09:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 201ace3f-a3d9-54ef-a0a1-f5df8b827770 with identifier: ZL28386
2026-03-30 09:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 201ace3f-a3d9-54ef-a0a1-f5df8b827770 with identifier: ZL28386
2026-03-30 09:09:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 201ace3f-a3d9-54ef-a0a1-f5df8b827770 with identifier: ZL28386 to the API
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:50:39Z',
 'fuel_type': 'diesel',
 'id': '201ace3f-a3d9-54ef-a0a1-f5df8b827770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL28386',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 159767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-15',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL28386%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Saving data for ZL28386: {'auction_closing_time': 1774885839.0, 'created_time': 1772779088.410196, 'last_price_update_time': 1774861775.596345}
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZL28386') HTTP/1.1" 204 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: KR37794
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: HY34989
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY34989%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for HY34989: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: XV25356
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: FP20263
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: RL97939
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL97939%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for RL97939: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: JY70774
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: UY39151
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: UP17064
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP17064%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for UP17064: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: TT52453
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT52453%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for TT52453: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: UR73173
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: DL97052
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL97052%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for DL97052: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: SM29752
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM29752%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for SM29752: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: WW47132
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW47132%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for WW47132: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: PJ46449
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: DX25254
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: DX82404
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: PK74621
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK74621%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for PK74621: 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: MJ86480
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: AR18622
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: MZ58050
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ58050%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for MZ58050: 2
2026-03-30 09:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d690ee7-d3ca-544d-a679-23c6925de100 with identifier: MZ58050
2026-03-30 09:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d690ee7-d3ca-544d-a679-23c6925de100 with scrape type 2
2026-03-30 09:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d690ee7-d3ca-544d-a679-23c6925de100 with scrape type 2
2026-03-30 09:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8d690ee7-d3ca-544d-a679-23c6925de100, identifier: MZ58050
2026-03-30 09:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8d690ee7-d3ca-544d-a679-23c6925de100 with identifier: MZ58050
2026-03-30 09:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8d690ee7-d3ca-544d-a679-23c6925de100 with identifier: MZ58050
2026-03-30 09:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8d690ee7-d3ca-544d-a679-23c6925de100 with identifier: MZ58050 to the API
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:10Z',
 'fuel_type': 'diesel',
 'id': '8d690ee7-d3ca-544d-a679-23c6925de100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ58050',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 446868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-16',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2019}
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ58050%27 HTTP/1.1" 200 None
2026-03-30 09:09:36 [auto1.it] INFO: Saving data for MZ58050: {'auction_closing_time': 1774883770.0, 'created_time': 1774645598.98886, 'last_price_update_time': 1774861776.342075}
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MZ58050') HTTP/1.1" 204 0
2026-03-30 09:09:36 [auto1.it] INFO: Found listing with ID: RB26067
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB26067%27 HTTP/1.1" 200 None
2026-03-30 09:09:36 [auto1.it] INFO: Scrape type for RB26067: 2
2026-03-30 09:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 428322fb-f4b2-5233-ac5c-24facc027a95 with identifier: RB26067
2026-03-30 09:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 428322fb-f4b2-5233-ac5c-24facc027a95 with scrape type 2
2026-03-30 09:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 428322fb-f4b2-5233-ac5c-24facc027a95 with scrape type 2
2026-03-30 09:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 428322fb-f4b2-5233-ac5c-24facc027a95, identifier: RB26067
2026-03-30 09:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 428322fb-f4b2-5233-ac5c-24facc027a95 with identifier: RB26067
2026-03-30 09:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 428322fb-f4b2-5233-ac5c-24facc027a95 with identifier: RB26067
2026-03-30 09:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 428322fb-f4b2-5233-ac5c-24facc027a95 with identifier: RB26067 to the API
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:27:40Z',
 'fuel_type': 'petrol',
 'id': '428322fb-f4b2-5233-ac5c-24facc027a95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB26067',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 36780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-30',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB26067%27 HTTP/1.1" 200 None
2026-03-30 09:09:36 [auto1.it] INFO: Saving data for RB26067: {'auction_closing_time': 1774884460.0, 'created_time': 1774256663.677266, 'last_price_update_time': 1774861776.856942}
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RB26067') HTTP/1.1" 204 0
2026-03-30 09:09:36 [auto1.it] INFO: Found listing with ID: XZ72452
2026-03-30 09:09:36 [auto1.it] INFO: Found listing with ID: TR59701
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR59701%27 HTTP/1.1" 200 None
2026-03-30 09:09:36 [auto1.it] INFO: Scrape type for TR59701: 2
2026-03-30 09:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78f988c8-383e-545d-803e-7580843d9dcd with identifier: TR59701
2026-03-30 09:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78f988c8-383e-545d-803e-7580843d9dcd with scrape type 2
2026-03-30 09:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78f988c8-383e-545d-803e-7580843d9dcd with scrape type 2
2026-03-30 09:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 78f988c8-383e-545d-803e-7580843d9dcd, identifier: TR59701
2026-03-30 09:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 78f988c8-383e-545d-803e-7580843d9dcd with identifier: TR59701
2026-03-30 09:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 78f988c8-383e-545d-803e-7580843d9dcd with identifier: TR59701
2026-03-30 09:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 78f988c8-383e-545d-803e-7580843d9dcd with identifier: TR59701 to the API
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:41:18Z',
 'fuel_type': 'diesel',
 'id': '78f988c8-383e-545d-803e-7580843d9dcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR59701',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 70428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-12',
 'seller_name': None,
 'title': 'Hyundai Kona 1.6 CRDi Exellence 2WD',
 'transmission': 'manual',
 'trim': 'Exellence 2WD',
 'year': 2019}
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR59701%27 HTTP/1.1" 200 None
2026-03-30 09:09:37 [auto1.it] INFO: Saving data for TR59701: {'auction_closing_time': 1774885278.0, 'created_time': 1774559016.47291, 'last_price_update_time': 1774861777.309377}
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TR59701') HTTP/1.1" 204 0
2026-03-30 09:09:37 [auto1.it] INFO: Found listing with ID: NV87278
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV87278%27 HTTP/1.1" 200 None
2026-03-30 09:09:37 [auto1.it] INFO: Scrape type for NV87278: 2
2026-03-30 09:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3774dac2-954f-512a-9ec8-31c3c4b4a73b with identifier: NV87278
2026-03-30 09:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3774dac2-954f-512a-9ec8-31c3c4b4a73b with scrape type 2
2026-03-30 09:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3774dac2-954f-512a-9ec8-31c3c4b4a73b with scrape type 2
2026-03-30 09:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3774dac2-954f-512a-9ec8-31c3c4b4a73b, identifier: NV87278
2026-03-30 09:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3774dac2-954f-512a-9ec8-31c3c4b4a73b with identifier: NV87278
2026-03-30 09:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3774dac2-954f-512a-9ec8-31c3c4b4a73b with identifier: NV87278
2026-03-30 09:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3774dac2-954f-512a-9ec8-31c3c4b4a73b with identifier: NV87278 to the API
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:40:21Z',
 'fuel_type': 'diesel',
 'id': '3774dac2-954f-512a-9ec8-31c3c4b4a73b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV87278',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 147122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-08',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Mild-Hybrid GT Line 2WD',
 'transmission': 'automatic',
 'trim': 'GT Line 2WD',
 'year': 2020}
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV87278%27 HTTP/1.1" 200 None
2026-03-30 09:09:38 [auto1.it] INFO: Saving data for NV87278: {'auction_closing_time': 1774885221.0, 'created_time': 1773867649.096534, 'last_price_update_time': 1774861778.152424}
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NV87278') HTTP/1.1" 204 0
2026-03-30 09:09:38 [auto1.it] INFO: Found listing with ID: SX19566
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX19566%27 HTTP/1.1" 200 None
2026-03-30 09:09:38 [auto1.it] INFO: Scrape type for SX19566: 0
2026-03-30 09:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:38 [auto1.it] INFO: Channel: 24h | Page: 63 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:38 [auto1.it] INFO: Found listing with ID: SJ09087
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ09087%27 HTTP/1.1" 200 None
2026-03-30 09:09:38 [auto1.it] INFO: Scrape type for SJ09087: 0
2026-03-30 09:09:38 [auto1.it] INFO: Found listing with ID: HY91699
2026-03-30 09:09:38 [auto1.it] INFO: Found listing with ID: YT66548
2026-03-30 09:09:38 [auto1.it] INFO: Found listing with ID: FD12268
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD12268%27 HTTP/1.1" 200 None
2026-03-30 09:09:38 [auto1.it] INFO: Scrape type for FD12268: 0
2026-03-30 09:09:38 [auto1.it] INFO: Found listing with ID: ZR48768
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR48768%27 HTTP/1.1" 200 None
2026-03-30 09:09:38 [auto1.it] INFO: Scrape type for ZR48768: 2
2026-03-30 09:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a26e28d8-2c52-5645-8572-deb65e58b182 with identifier: ZR48768
2026-03-30 09:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a26e28d8-2c52-5645-8572-deb65e58b182 with scrape type 2
2026-03-30 09:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a26e28d8-2c52-5645-8572-deb65e58b182 with scrape type 2
2026-03-30 09:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a26e28d8-2c52-5645-8572-deb65e58b182, identifier: ZR48768
2026-03-30 09:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a26e28d8-2c52-5645-8572-deb65e58b182 with identifier: ZR48768
2026-03-30 09:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a26e28d8-2c52-5645-8572-deb65e58b182 with identifier: ZR48768
2026-03-30 09:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a26e28d8-2c52-5645-8572-deb65e58b182 with identifier: ZR48768 to the API
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:15:43Z',
 'fuel_type': 'diesel',
 'id': 'a26e28d8-2c52-5645-8572-deb65e58b182',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR48768',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 331789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-29',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR48768%27 HTTP/1.1" 200 None
2026-03-30 09:09:38 [auto1.it] INFO: Saving data for ZR48768: {'auction_closing_time': 1774883743.0, 'created_time': 1774559174.214775, 'last_price_update_time': 1774861778.762009}
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZR48768') HTTP/1.1" 204 0
2026-03-30 09:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:38 [auto1.it] INFO: Found listing with ID: CB66149
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB66149%27 HTTP/1.1" 200 None
2026-03-30 09:09:38 [auto1.it] INFO: Scrape type for CB66149: 2
2026-03-30 09:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ae716f3-26c3-51ef-82cd-4c7e8b6ba20d with identifier: CB66149
2026-03-30 09:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ae716f3-26c3-51ef-82cd-4c7e8b6ba20d with scrape type 2
2026-03-30 09:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ae716f3-26c3-51ef-82cd-4c7e8b6ba20d with scrape type 2
2026-03-30 09:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9ae716f3-26c3-51ef-82cd-4c7e8b6ba20d, identifier: CB66149
2026-03-30 09:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9ae716f3-26c3-51ef-82cd-4c7e8b6ba20d with identifier: CB66149
2026-03-30 09:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9ae716f3-26c3-51ef-82cd-4c7e8b6ba20d with identifier: CB66149
2026-03-30 09:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9ae716f3-26c3-51ef-82cd-4c7e8b6ba20d with identifier: CB66149 to the API
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:05:42Z',
 'fuel_type': 'diesel',
 'id': '9ae716f3-26c3-51ef-82cd-4c7e8b6ba20d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB66149',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 144600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-27',
 'seller_name': None,
 'title': 'BMW X1 sDrive 16d xLine',
 'transmission': 'manual',
 'trim': 'xLine',
 'year': 2016}
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB66149%27 HTTP/1.1" 200 None
2026-03-30 09:09:39 [auto1.it] INFO: Saving data for CB66149: {'auction_closing_time': 1774883142.0, 'created_time': 1774559029.837048, 'last_price_update_time': 1774861779.345928}
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CB66149') HTTP/1.1" 204 0
2026-03-30 09:09:39 [auto1.it] INFO: Found listing with ID: RE68635
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE68635%27 HTTP/1.1" 200 None
2026-03-30 09:09:39 [auto1.it] INFO: Scrape type for RE68635: 0
2026-03-30 09:09:39 [auto1.it] INFO: Found listing with ID: UM17769
2026-03-30 09:09:39 [auto1.it] INFO: Found listing with ID: HW61207
2026-03-30 09:09:39 [auto1.it] INFO: Found listing with ID: GA57810
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA57810%27 HTTP/1.1" 200 None
2026-03-30 09:09:39 [auto1.it] INFO: Scrape type for GA57810: 2
2026-03-30 09:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1142f35a-d4ce-53f0-93ae-2517969b747e with identifier: GA57810
2026-03-30 09:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1142f35a-d4ce-53f0-93ae-2517969b747e with scrape type 2
2026-03-30 09:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1142f35a-d4ce-53f0-93ae-2517969b747e with scrape type 2
2026-03-30 09:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1142f35a-d4ce-53f0-93ae-2517969b747e, identifier: GA57810
2026-03-30 09:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1142f35a-d4ce-53f0-93ae-2517969b747e with identifier: GA57810
2026-03-30 09:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1142f35a-d4ce-53f0-93ae-2517969b747e with identifier: GA57810
2026-03-30 09:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1142f35a-d4ce-53f0-93ae-2517969b747e with identifier: GA57810 to the API
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:19:48Z',
 'fuel_type': 'diesel',
 'id': '1142f35a-d4ce-53f0-93ae-2517969b747e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA57810',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 142515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-29',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Advanced',
 'transmission': 'manual',
 'trim': 'Advanced',
 'year': 2013}
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA57810%27 HTTP/1.1" 200 None
2026-03-30 09:09:39 [auto1.it] INFO: Saving data for GA57810: {'auction_closing_time': 1774883988.0, 'created_time': 1774558966.194518, 'last_price_update_time': 1774861779.859868}
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GA57810') HTTP/1.1" 204 0
2026-03-30 09:09:39 [auto1.it] INFO: Found listing with ID: VD70212
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD70212%27 HTTP/1.1" 200 None
2026-03-30 09:09:39 [auto1.it] INFO: Scrape type for VD70212: 0
2026-03-30 09:09:39 [auto1.it] INFO: Found listing with ID: JK09197
2026-03-30 09:09:39 [auto1.it] INFO: Found listing with ID: CA31078
2026-03-30 09:09:39 [auto1.it] INFO: Found listing with ID: UN97193
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN97193%27 HTTP/1.1" 200 None
2026-03-30 09:09:39 [auto1.it] INFO: Scrape type for UN97193: 0
2026-03-30 09:09:39 [auto1.it] INFO: Found listing with ID: JS13846
2026-03-30 09:09:39 [auto1.it] INFO: Found listing with ID: JT98079
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT98079%27 HTTP/1.1" 200 None
2026-03-30 09:09:39 [auto1.it] INFO: Scrape type for JT98079: 2
2026-03-30 09:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51638813-f739-53d8-b17d-aab42a072cb3 with identifier: JT98079
2026-03-30 09:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51638813-f739-53d8-b17d-aab42a072cb3 with scrape type 2
2026-03-30 09:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51638813-f739-53d8-b17d-aab42a072cb3 with scrape type 2
2026-03-30 09:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 51638813-f739-53d8-b17d-aab42a072cb3, identifier: JT98079
2026-03-30 09:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 51638813-f739-53d8-b17d-aab42a072cb3 with identifier: JT98079
2026-03-30 09:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 51638813-f739-53d8-b17d-aab42a072cb3 with identifier: JT98079
2026-03-30 09:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 51638813-f739-53d8-b17d-aab42a072cb3 with identifier: JT98079 to the API
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:58:23Z',
 'fuel_type': 'diesel',
 'id': '51638813-f739-53d8-b17d-aab42a072cb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT98079',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 51456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-24',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2020}
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT98079%27 HTTP/1.1" 200 None
2026-03-30 09:09:40 [auto1.it] INFO: Saving data for JT98079: {'auction_closing_time': 1774886303.0, 'created_time': 1774645677.269331, 'last_price_update_time': 1774861780.291286}
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JT98079') HTTP/1.1" 204 0
2026-03-30 09:09:40 [auto1.it] INFO: Found listing with ID: ZN14128
2026-03-30 09:09:40 [auto1.it] INFO: Found listing with ID: HS75428
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS75428%27 HTTP/1.1" 200 None
2026-03-30 09:09:40 [auto1.it] INFO: Scrape type for HS75428: 2
2026-03-30 09:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02080ecc-8e0c-5145-94e4-6b7fed67796a with identifier: HS75428
2026-03-30 09:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02080ecc-8e0c-5145-94e4-6b7fed67796a with scrape type 2
2026-03-30 09:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02080ecc-8e0c-5145-94e4-6b7fed67796a with scrape type 2
2026-03-30 09:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 02080ecc-8e0c-5145-94e4-6b7fed67796a, identifier: HS75428
2026-03-30 09:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 02080ecc-8e0c-5145-94e4-6b7fed67796a with identifier: HS75428
2026-03-30 09:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 02080ecc-8e0c-5145-94e4-6b7fed67796a with identifier: HS75428
2026-03-30 09:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 02080ecc-8e0c-5145-94e4-6b7fed67796a with identifier: HS75428 to the API
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:29:19Z',
 'fuel_type': 'diesel',
 'id': '02080ecc-8e0c-5145-94e4-6b7fed67796a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS75428',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 261766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-30',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI B-Color',
 'transmission': 'manual',
 'trim': 'B-Color',
 'year': 2014}
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS75428%27 HTTP/1.1" 200 None
2026-03-30 09:09:40 [auto1.it] INFO: Saving data for HS75428: {'auction_closing_time': 1774884559.0, 'created_time': 1774559124.817082, 'last_price_update_time': 1774861780.866586}
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HS75428') HTTP/1.1" 204 0
2026-03-30 09:09:40 [auto1.it] INFO: Found listing with ID: GA45330
2026-03-30 09:09:40 [auto1.it] INFO: Found listing with ID: LR95961
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR95961%27 HTTP/1.1" 200 None
2026-03-30 09:09:41 [auto1.it] INFO: Scrape type for LR95961: 0
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: UU49973
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: EB11724
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: WY28975
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY28975%27 HTTP/1.1" 200 None
2026-03-30 09:09:41 [auto1.it] INFO: Scrape type for WY28975: 0
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: XP84134
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: RV64880
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: XH17321
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: ES64600
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: TG93645
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG93645%27 HTTP/1.1" 200 None
2026-03-30 09:09:41 [auto1.it] INFO: Scrape type for TG93645: 2
2026-03-30 09:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10147993-f2b0-53ec-985b-378e04f22aef with identifier: TG93645
2026-03-30 09:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10147993-f2b0-53ec-985b-378e04f22aef with scrape type 2
2026-03-30 09:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10147993-f2b0-53ec-985b-378e04f22aef with scrape type 2
2026-03-30 09:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 10147993-f2b0-53ec-985b-378e04f22aef, identifier: TG93645
2026-03-30 09:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 10147993-f2b0-53ec-985b-378e04f22aef with identifier: TG93645
2026-03-30 09:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 10147993-f2b0-53ec-985b-378e04f22aef with identifier: TG93645
2026-03-30 09:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 10147993-f2b0-53ec-985b-378e04f22aef with identifier: TG93645 to the API
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:39:08Z',
 'fuel_type': 'diesel',
 'id': '10147993-f2b0-53ec-985b-378e04f22aef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG93645',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 167696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-27',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTD Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2018}
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG93645%27 HTTP/1.1" 200 None
2026-03-30 09:09:41 [auto1.it] INFO: Saving data for TG93645: {'auction_closing_time': 1774885148.0, 'created_time': 1773867682.610283, 'last_price_update_time': 1774861781.777249}
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TG93645') HTTP/1.1" 204 0
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: XY26314
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY26314%27 HTTP/1.1" 200 None
2026-03-30 09:09:41 [auto1.it] INFO: Scrape type for XY26314: 0
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: XJ87572
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ87572%27 HTTP/1.1" 200 None
2026-03-30 09:09:41 [auto1.it] INFO: Scrape type for XJ87572: 0
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: DV39460
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV39460%27 HTTP/1.1" 200 None
2026-03-30 09:09:41 [auto1.it] INFO: Scrape type for DV39460: 0
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: CP04601
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP04601%27 HTTP/1.1" 200 None
2026-03-30 09:09:41 [auto1.it] INFO: Scrape type for CP04601: 0
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: KV97590
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: PR97766
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR97766%27 HTTP/1.1" 200 None
2026-03-30 09:09:41 [auto1.it] INFO: Scrape type for PR97766: 0
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: NT74531
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT74531%27 HTTP/1.1" 200 None
2026-03-30 09:09:41 [auto1.it] INFO: Scrape type for NT74531: 0
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: BF34891
2026-03-30 09:09:41 [auto1.it] INFO: Found listing with ID: CA25129
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA25129%27 HTTP/1.1" 200 None
2026-03-30 09:09:41 [auto1.it] INFO: Scrape type for CA25129: 2
2026-03-30 09:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 075463a7-e427-507b-8a68-ba33f67cd3d3 with identifier: CA25129
2026-03-30 09:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 075463a7-e427-507b-8a68-ba33f67cd3d3 with scrape type 2
2026-03-30 09:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 075463a7-e427-507b-8a68-ba33f67cd3d3 with scrape type 2
2026-03-30 09:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 075463a7-e427-507b-8a68-ba33f67cd3d3, identifier: CA25129
2026-03-30 09:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 075463a7-e427-507b-8a68-ba33f67cd3d3 with identifier: CA25129
2026-03-30 09:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 075463a7-e427-507b-8a68-ba33f67cd3d3 with identifier: CA25129
2026-03-30 09:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 075463a7-e427-507b-8a68-ba33f67cd3d3 with identifier: CA25129 to the API
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:40:24Z',
 'fuel_type': 'diesel',
 'id': '075463a7-e427-507b-8a68-ba33f67cd3d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA25129',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion Tech',
 'year': 2014}
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA25129%27 HTTP/1.1" 200 None
2026-03-30 09:09:42 [auto1.it] INFO: Saving data for CA25129: {'auction_closing_time': 1774885224.0, 'created_time': 1773663534.268307, 'last_price_update_time': 1774861782.324753}
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CA25129') HTTP/1.1" 204 0
2026-03-30 09:09:42 [auto1.it] INFO: Found listing with ID: DV62458
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV62458%27 HTTP/1.1" 200 None
2026-03-30 09:09:42 [auto1.it] INFO: Scrape type for DV62458: 0
2026-03-30 09:09:42 [auto1.it] INFO: Found listing with ID: JF27717
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF27717%27 HTTP/1.1" 200 None
2026-03-30 09:09:42 [auto1.it] INFO: Scrape type for JF27717: 0
2026-03-30 09:09:42 [auto1.it] INFO: Found listing with ID: NP04036
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP04036%27 HTTP/1.1" 200 None
2026-03-30 09:09:42 [auto1.it] INFO: Scrape type for NP04036: 2
2026-03-30 09:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e958c999-a6a3-5dfe-93ee-8f14ba71a053 with identifier: NP04036
2026-03-30 09:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e958c999-a6a3-5dfe-93ee-8f14ba71a053 with scrape type 2
2026-03-30 09:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e958c999-a6a3-5dfe-93ee-8f14ba71a053 with scrape type 2
2026-03-30 09:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e958c999-a6a3-5dfe-93ee-8f14ba71a053, identifier: NP04036
2026-03-30 09:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e958c999-a6a3-5dfe-93ee-8f14ba71a053 with identifier: NP04036
2026-03-30 09:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e958c999-a6a3-5dfe-93ee-8f14ba71a053 with identifier: NP04036
2026-03-30 09:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e958c999-a6a3-5dfe-93ee-8f14ba71a053 with identifier: NP04036 to the API
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:57:53Z',
 'fuel_type': 'diesel',
 'id': 'e958c999-a6a3-5dfe-93ee-8f14ba71a053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP04036',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 207366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-28',
 'seller_name': None,
 'title': 'Seat Ibiza 1.9 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2007}
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP04036%27 HTTP/1.1" 200 None
2026-03-30 09:09:42 [auto1.it] INFO: Saving data for NP04036: {'auction_closing_time': 1774886273.0, 'created_time': 1774559189.544778, 'last_price_update_time': 1774861782.919181}
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NP04036') HTTP/1.1" 204 0
2026-03-30 09:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:43 [auto1.it] INFO: Channel: 24h | Page: 64 | totalHits: 3308 | hits on page: 40
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: NP04036
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP04036%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for NP04036: 0
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: RX07844
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: LF46608
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: TS59592
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS59592%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for TS59592: 0
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: KT26389
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: FF22275
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF22275%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for FF22275: 0
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: RZ99853
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ99853%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for RZ99853: 0
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: NB02604
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: RU45122
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU45122%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for RU45122: 0
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: GY05881
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY05881%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for GY05881: 0
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: TT28559
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: MY33245
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: BG42211
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: BK04078
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: AY46194
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: MW84295
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW84295%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for MW84295: 0
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: YY01932
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY01932%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for YY01932: 0
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: ED17590
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED17590%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for ED17590: 0
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: GT34435
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT34435%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for GT34435: 0
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: SC91639
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: VA29565
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: BG55667
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: PD51522
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: CH35422
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH35422%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for CH35422: 0
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: FK45797
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: RA11036
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA11036%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for RA11036: 0
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: AC52318
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: DS09153
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: TF37027
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: DW71358
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW71358%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for DW71358: 2
2026-03-30 09:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b54f2632-0b38-5647-9fac-7a98da1c03e8 with identifier: DW71358
2026-03-30 09:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b54f2632-0b38-5647-9fac-7a98da1c03e8 with scrape type 2
2026-03-30 09:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b54f2632-0b38-5647-9fac-7a98da1c03e8 with scrape type 2
2026-03-30 09:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b54f2632-0b38-5647-9fac-7a98da1c03e8, identifier: DW71358
2026-03-30 09:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b54f2632-0b38-5647-9fac-7a98da1c03e8 with identifier: DW71358
2026-03-30 09:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b54f2632-0b38-5647-9fac-7a98da1c03e8 with identifier: DW71358
2026-03-30 09:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b54f2632-0b38-5647-9fac-7a98da1c03e8 with identifier: DW71358 to the API
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:26:21Z',
 'fuel_type': 'hybrid',
 'id': 'b54f2632-0b38-5647-9fac-7a98da1c03e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW71358',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 182108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 Hybrid GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2021}
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW71358%27 HTTP/1.1" 200 None
2026-03-30 09:09:44 [auto1.it] INFO: Saving data for DW71358: {'auction_closing_time': 1774884381.0, 'created_time': 1773134295.019553, 'last_price_update_time': 1774861784.054285}
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DW71358') HTTP/1.1" 204 0
2026-03-30 09:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:44 [auto1.it] INFO: Found listing with ID: CA07197
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA07197%27 HTTP/1.1" 200 None
2026-03-30 09:09:44 [auto1.it] INFO: Scrape type for CA07197: 0
2026-03-30 09:09:44 [auto1.it] INFO: Found listing with ID: AA46193
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA46193%27 HTTP/1.1" 200 None
2026-03-30 09:09:44 [auto1.it] INFO: Scrape type for AA46193: 0
2026-03-30 09:09:44 [auto1.it] INFO: Found listing with ID: XY19791
2026-03-30 09:09:44 [auto1.it] INFO: Found listing with ID: FB26923
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB26923%27 HTTP/1.1" 200 None
2026-03-30 09:09:44 [auto1.it] INFO: Scrape type for FB26923: 2
2026-03-30 09:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75754bfc-183c-57b9-9242-b85bfb8d857a with identifier: FB26923
2026-03-30 09:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75754bfc-183c-57b9-9242-b85bfb8d857a with scrape type 2
2026-03-30 09:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75754bfc-183c-57b9-9242-b85bfb8d857a with scrape type 2
2026-03-30 09:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 75754bfc-183c-57b9-9242-b85bfb8d857a, identifier: FB26923
2026-03-30 09:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 75754bfc-183c-57b9-9242-b85bfb8d857a with identifier: FB26923
2026-03-30 09:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 75754bfc-183c-57b9-9242-b85bfb8d857a with identifier: FB26923
2026-03-30 09:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 75754bfc-183c-57b9-9242-b85bfb8d857a with identifier: FB26923 to the API
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:23:56Z',
 'fuel_type': 'petrol',
 'id': '75754bfc-183c-57b9-9242-b85bfb8d857a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB26923',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 133393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-30',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Natural Power Panda',
 'transmission': 'manual',
 'trim': 'Natural Power',
 'year': 2009}
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB26923%27 HTTP/1.1" 200 None
2026-03-30 09:09:44 [auto1.it] INFO: Saving data for FB26923: {'auction_closing_time': 1774884236.0, 'created_time': 1774267379.163546, 'last_price_update_time': 1774861784.670841}
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FB26923') HTTP/1.1" 204 0
2026-03-30 09:09:44 [auto1.it] INFO: Found listing with ID: KA77498
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA77498%27 HTTP/1.1" 200 None
2026-03-30 09:09:44 [auto1.it] INFO: Scrape type for KA77498: 0
2026-03-30 09:09:44 [auto1.it] INFO: Found listing with ID: PP30320
2026-03-30 09:09:44 [auto1.it] INFO: Found listing with ID: GW20586
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW20586%27 HTTP/1.1" 200 None
2026-03-30 09:09:44 [auto1.it] INFO: Scrape type for GW20586: 0
2026-03-30 09:09:44 [auto1.it] INFO: Found listing with ID: DV74338
2026-03-30 09:09:44 [auto1.it] INFO: Found listing with ID: WB02542
2026-03-30 09:09:44 [auto1.it] INFO: Found listing with ID: PK39445
2026-03-30 09:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:49 [auto1.it] INFO: Channel: 24h | Page: 65 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:49 [auto1.it] INFO: Found listing with ID: XX93100
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX93100%27 HTTP/1.1" 200 None
2026-03-30 09:09:49 [auto1.it] INFO: Scrape type for XX93100: 2
2026-03-30 09:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 661ff779-846c-5ebd-883f-f9dc30c7daab with identifier: XX93100
2026-03-30 09:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 661ff779-846c-5ebd-883f-f9dc30c7daab with scrape type 2
2026-03-30 09:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 661ff779-846c-5ebd-883f-f9dc30c7daab with scrape type 2
2026-03-30 09:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 661ff779-846c-5ebd-883f-f9dc30c7daab, identifier: XX93100
2026-03-30 09:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 661ff779-846c-5ebd-883f-f9dc30c7daab with identifier: XX93100
2026-03-30 09:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 661ff779-846c-5ebd-883f-f9dc30c7daab with identifier: XX93100
2026-03-30 09:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 661ff779-846c-5ebd-883f-f9dc30c7daab with identifier: XX93100 to the API
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:16:48Z',
 'fuel_type': 'diesel',
 'id': '661ff779-846c-5ebd-883f-f9dc30c7daab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX93100',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 205874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-13',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 3.0 V6 Diesel R-Dynamic HSE',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE',
 'year': 2017}
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX93100%27 HTTP/1.1" 200 None
2026-03-30 09:09:50 [auto1.it] INFO: Saving data for XX93100: {'auction_closing_time': 1774883808.0, 'created_time': 1773781442.351227, 'last_price_update_time': 1774861790.120966}
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX93100') HTTP/1.1" 204 0
2026-03-30 09:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:50 [auto1.it] INFO: Found listing with ID: AM26734
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM26734%27 HTTP/1.1" 200 None
2026-03-30 09:09:50 [auto1.it] INFO: Scrape type for AM26734: 2
2026-03-30 09:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e144ce7-d2d3-5568-89fd-039fa61d6bfa with identifier: AM26734
2026-03-30 09:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e144ce7-d2d3-5568-89fd-039fa61d6bfa with scrape type 2
2026-03-30 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e144ce7-d2d3-5568-89fd-039fa61d6bfa with scrape type 2
2026-03-30 09:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9e144ce7-d2d3-5568-89fd-039fa61d6bfa, identifier: AM26734
2026-03-30 09:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9e144ce7-d2d3-5568-89fd-039fa61d6bfa with identifier: AM26734
2026-03-30 09:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9e144ce7-d2d3-5568-89fd-039fa61d6bfa with identifier: AM26734
2026-03-30 09:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9e144ce7-d2d3-5568-89fd-039fa61d6bfa with identifier: AM26734 to the API
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:58Z',
 'fuel_type': 'diesel',
 'id': '9e144ce7-d2d3-5568-89fd-039fa61d6bfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM26734',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 122736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM26734%27 HTTP/1.1" 200 None
2026-03-30 09:09:50 [auto1.it] INFO: Saving data for AM26734: {'auction_closing_time': 1774883458.0, 'created_time': 1774558984.469252, 'last_price_update_time': 1774861790.62517}
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AM26734') HTTP/1.1" 204 0
2026-03-30 09:09:50 [auto1.it] INFO: Found listing with ID: SX21241
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX21241%27 HTTP/1.1" 200 None
2026-03-30 09:09:50 [auto1.it] INFO: Scrape type for SX21241: 2
2026-03-30 09:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac6eb6b6-b85a-5b0c-92d0-bf331060f4a9 with identifier: SX21241
2026-03-30 09:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac6eb6b6-b85a-5b0c-92d0-bf331060f4a9 with scrape type 2
2026-03-30 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac6eb6b6-b85a-5b0c-92d0-bf331060f4a9 with scrape type 2
2026-03-30 09:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ac6eb6b6-b85a-5b0c-92d0-bf331060f4a9, identifier: SX21241
2026-03-30 09:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ac6eb6b6-b85a-5b0c-92d0-bf331060f4a9 with identifier: SX21241
2026-03-30 09:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ac6eb6b6-b85a-5b0c-92d0-bf331060f4a9 with identifier: SX21241
2026-03-30 09:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ac6eb6b6-b85a-5b0c-92d0-bf331060f4a9 with identifier: SX21241 to the API
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:34:26Z',
 'fuel_type': 'diesel',
 'id': 'ac6eb6b6-b85a-5b0c-92d0-bf331060f4a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX21241',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 133769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-29',
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX21241%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Saving data for SX21241: {'auction_closing_time': 1774884866.0, 'created_time': 1773824455.166909, 'last_price_update_time': 1774861791.138617}
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SX21241') HTTP/1.1" 204 0
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: NC70942
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC70942%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Scrape type for NC70942: 0
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: HM03162
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM03162%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Scrape type for HM03162: 0
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: AD83412
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: SK74491
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: HL13838
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: LY98983
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY98983%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Scrape type for LY98983: 0
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: TZ05140
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: EA08863
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA08863%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Scrape type for EA08863: 0
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: SP76043
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP76043%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Scrape type for SP76043: 0
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: TP07930
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP07930%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Scrape type for TP07930: 0
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: NJ20872
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ20872%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Scrape type for NJ20872: 0
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: VF45343
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF45343%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Scrape type for VF45343: 2
2026-03-30 09:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8258d8db-67dd-5daf-bf6b-a88d9032562c with identifier: VF45343
2026-03-30 09:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8258d8db-67dd-5daf-bf6b-a88d9032562c with scrape type 2
2026-03-30 09:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8258d8db-67dd-5daf-bf6b-a88d9032562c with scrape type 2
2026-03-30 09:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8258d8db-67dd-5daf-bf6b-a88d9032562c, identifier: VF45343
2026-03-30 09:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8258d8db-67dd-5daf-bf6b-a88d9032562c with identifier: VF45343
2026-03-30 09:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8258d8db-67dd-5daf-bf6b-a88d9032562c with identifier: VF45343
2026-03-30 09:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8258d8db-67dd-5daf-bf6b-a88d9032562c with identifier: VF45343 to the API
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:10:58Z',
 'fuel_type': 'diesel',
 'id': '8258d8db-67dd-5daf-bf6b-a88d9032562c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF45343',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 156890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2019}
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF45343%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Saving data for VF45343: {'auction_closing_time': 1774883458.0, 'created_time': 1774645406.223999, 'last_price_update_time': 1774861791.66261}
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VF45343') HTTP/1.1" 204 0
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: UH24894
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH24894%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Scrape type for UH24894: 0
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: CA11723
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA11723%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Scrape type for CA11723: 2
2026-03-30 09:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b753ede8-d72b-578e-aeed-245de9e26a69 with identifier: CA11723
2026-03-30 09:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b753ede8-d72b-578e-aeed-245de9e26a69 with scrape type 2
2026-03-30 09:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b753ede8-d72b-578e-aeed-245de9e26a69 with scrape type 2
2026-03-30 09:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b753ede8-d72b-578e-aeed-245de9e26a69, identifier: CA11723
2026-03-30 09:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b753ede8-d72b-578e-aeed-245de9e26a69 with identifier: CA11723
2026-03-30 09:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b753ede8-d72b-578e-aeed-245de9e26a69 with identifier: CA11723
2026-03-30 09:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b753ede8-d72b-578e-aeed-245de9e26a69 with identifier: CA11723 to the API
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:01:40Z',
 'fuel_type': 'diesel',
 'id': 'b753ede8-d72b-578e-aeed-245de9e26a69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA11723',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 144522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-28',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2019}
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA11723%27 HTTP/1.1" 200 None
2026-03-30 09:09:52 [auto1.it] INFO: Saving data for CA11723: {'auction_closing_time': 1774882900.0, 'created_time': 1773304978.262044, 'last_price_update_time': 1774861792.240052}
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CA11723') HTTP/1.1" 204 0
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: SB88786
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: UC27147
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC27147%27 HTTP/1.1" 200 None
2026-03-30 09:09:52 [auto1.it] INFO: Scrape type for UC27147: 0
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: BA15195
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: FW75637
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW75637%27 HTTP/1.1" 200 None
2026-03-30 09:09:52 [auto1.it] INFO: Scrape type for FW75637: 0
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: NT25208
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT25208%27 HTTP/1.1" 200 None
2026-03-30 09:09:52 [auto1.it] INFO: Scrape type for NT25208: 0
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: XK39914
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: FM41301
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM41301%27 HTTP/1.1" 200 None
2026-03-30 09:09:52 [auto1.it] INFO: Scrape type for FM41301: 2
2026-03-30 09:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1405595-b71f-5e5c-ad74-4cc3ae0a4347 with identifier: FM41301
2026-03-30 09:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1405595-b71f-5e5c-ad74-4cc3ae0a4347 with scrape type 2
2026-03-30 09:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1405595-b71f-5e5c-ad74-4cc3ae0a4347 with scrape type 2
2026-03-30 09:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f1405595-b71f-5e5c-ad74-4cc3ae0a4347, identifier: FM41301
2026-03-30 09:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f1405595-b71f-5e5c-ad74-4cc3ae0a4347 with identifier: FM41301
2026-03-30 09:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f1405595-b71f-5e5c-ad74-4cc3ae0a4347 with identifier: FM41301
2026-03-30 09:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f1405595-b71f-5e5c-ad74-4cc3ae0a4347 with identifier: FM41301 to the API
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:06Z',
 'fuel_type': 'petrol',
 'id': 'f1405595-b71f-5e5c-ad74-4cc3ae0a4347',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM41301',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 43474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T-GDi 80th Anniversary FWD',
 'transmission': 'automatic',
 'trim': '80th Anniversary FWD',
 'year': 2021}
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM41301%27 HTTP/1.1" 200 None
2026-03-30 09:09:52 [auto1.it] INFO: Saving data for FM41301: {'auction_closing_time': 1774884726.0, 'created_time': 1774558828.477142, 'last_price_update_time': 1774861792.741235}
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FM41301') HTTP/1.1" 204 0
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: KN82468
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: PT72554
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: SK80279
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: TP30919
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: XT40512
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT40512%27 HTTP/1.1" 200 None
2026-03-30 09:09:52 [auto1.it] INFO: Scrape type for XT40512: 2
2026-03-30 09:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cb7455d-38bc-5f70-8470-62033d78b2a3 with identifier: XT40512
2026-03-30 09:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cb7455d-38bc-5f70-8470-62033d78b2a3 with scrape type 2
2026-03-30 09:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cb7455d-38bc-5f70-8470-62033d78b2a3 with scrape type 2
2026-03-30 09:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8cb7455d-38bc-5f70-8470-62033d78b2a3, identifier: XT40512
2026-03-30 09:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8cb7455d-38bc-5f70-8470-62033d78b2a3 with identifier: XT40512
2026-03-30 09:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8cb7455d-38bc-5f70-8470-62033d78b2a3 with identifier: XT40512
2026-03-30 09:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8cb7455d-38bc-5f70-8470-62033d78b2a3 with identifier: XT40512 to the API
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:18:06Z',
 'fuel_type': 'petrol',
 'id': '8cb7455d-38bc-5f70-8470-62033d78b2a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT40512',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 91651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT40512%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [auto1.it] INFO: Saving data for XT40512: {'auction_closing_time': 1774883886.0, 'created_time': 1773129730.756274, 'last_price_update_time': 1774861793.176626}
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XT40512') HTTP/1.1" 204 0
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: BE00528
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE00528%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [auto1.it] INFO: Scrape type for BE00528: 0
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: EE91281
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: DP98700
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP98700%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [auto1.it] INFO: Scrape type for DP98700: 0
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: TX96321
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX96321%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [auto1.it] INFO: Scrape type for TX96321: 0
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: RP23530
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP23530%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [auto1.it] INFO: Scrape type for RP23530: 0
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: JC41210
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC41210%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [auto1.it] INFO: Scrape type for JC41210: 2
2026-03-30 09:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c64413e2-88db-5ade-9a26-7cc97708dceb with identifier: JC41210
2026-03-30 09:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c64413e2-88db-5ade-9a26-7cc97708dceb with scrape type 2
2026-03-30 09:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c64413e2-88db-5ade-9a26-7cc97708dceb with scrape type 2
2026-03-30 09:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c64413e2-88db-5ade-9a26-7cc97708dceb, identifier: JC41210
2026-03-30 09:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c64413e2-88db-5ade-9a26-7cc97708dceb with identifier: JC41210
2026-03-30 09:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c64413e2-88db-5ade-9a26-7cc97708dceb with identifier: JC41210
2026-03-30 09:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c64413e2-88db-5ade-9a26-7cc97708dceb with identifier: JC41210 to the API
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:45:37Z',
 'fuel_type': 'diesel',
 'id': 'c64413e2-88db-5ade-9a26-7cc97708dceb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC41210',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 123680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC41210%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [auto1.it] INFO: Saving data for JC41210: {'auction_closing_time': 1774885537.0, 'created_time': 1773759781.570229, 'last_price_update_time': 1774861793.848041}
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JC41210') HTTP/1.1" 204 0
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: KW78911
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: XX72461
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX72461%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [auto1.it] INFO: Scrape type for XX72461: 0
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: AJ45475
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: RB61179
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB61179%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [auto1.it] INFO: Scrape type for RB61179: 2
2026-03-30 09:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e4e274-3b50-5d82-8ceb-236d9940d5b9 with identifier: RB61179
2026-03-30 09:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e4e274-3b50-5d82-8ceb-236d9940d5b9 with scrape type 2
2026-03-30 09:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e4e274-3b50-5d82-8ceb-236d9940d5b9 with scrape type 2
2026-03-30 09:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 70e4e274-3b50-5d82-8ceb-236d9940d5b9, identifier: RB61179
2026-03-30 09:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 70e4e274-3b50-5d82-8ceb-236d9940d5b9 with identifier: RB61179
2026-03-30 09:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 70e4e274-3b50-5d82-8ceb-236d9940d5b9 with identifier: RB61179
2026-03-30 09:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 70e4e274-3b50-5d82-8ceb-236d9940d5b9 with identifier: RB61179 to the API
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:24:30Z',
 'fuel_type': 'diesel',
 'id': '70e4e274-3b50-5d82-8ceb-236d9940d5b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB61179',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 160173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 V6 TDI SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2017}
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB61179%27 HTTP/1.1" 200 None
2026-03-30 09:09:54 [auto1.it] INFO: Saving data for RB61179: {'auction_closing_time': 1774884270.0, 'created_time': 1773835771.337902, 'last_price_update_time': 1774861794.276316}
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RB61179') HTTP/1.1" 204 0
2026-03-30 09:09:54 [auto1.it] INFO: Found listing with ID: RA46767
2026-03-30 09:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:54 [auto1.it] INFO: Channel: 24h | Page: 66 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:54 [auto1.it] INFO: Found listing with ID: NK94790
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK94790%27 HTTP/1.1" 200 None
2026-03-30 09:09:54 [auto1.it] INFO: Scrape type for NK94790: 2
2026-03-30 09:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69289b5a-e521-5453-aa41-6b7e7c99beec with identifier: NK94790
2026-03-30 09:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69289b5a-e521-5453-aa41-6b7e7c99beec with scrape type 2
2026-03-30 09:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69289b5a-e521-5453-aa41-6b7e7c99beec with scrape type 2
2026-03-30 09:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 69289b5a-e521-5453-aa41-6b7e7c99beec, identifier: NK94790
2026-03-30 09:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 69289b5a-e521-5453-aa41-6b7e7c99beec with identifier: NK94790
2026-03-30 09:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 69289b5a-e521-5453-aa41-6b7e7c99beec with identifier: NK94790
2026-03-30 09:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 69289b5a-e521-5453-aa41-6b7e7c99beec with identifier: NK94790 to the API
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:53:22Z',
 'fuel_type': 'petrol',
 'id': '69289b5a-e521-5453-aa41-6b7e7c99beec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK94790',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 309831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-29',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Fresh BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Fresh BlueMotion Tech',
 'year': 2014}
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK94790%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [auto1.it] INFO: Saving data for NK94790: {'auction_closing_time': 1774886002.0, 'created_time': 1774558932.442892, 'last_price_update_time': 1774861795.083641}
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NK94790') HTTP/1.1" 204 0
2026-03-30 09:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: GE08005
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE08005%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [auto1.it] INFO: Scrape type for GE08005: 0
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: GM28799
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: NP81459
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: KD77242
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: BH96807
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH96807%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [auto1.it] INFO: Scrape type for BH96807: 0
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: DZ90619
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: BT34353
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: GR65234
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR65234%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [auto1.it] INFO: Scrape type for GR65234: 2
2026-03-30 09:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c12f9e0b-9387-51f0-baf1-ff760cedceb2 with identifier: GR65234
2026-03-30 09:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c12f9e0b-9387-51f0-baf1-ff760cedceb2 with scrape type 2
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c12f9e0b-9387-51f0-baf1-ff760cedceb2 with scrape type 2
2026-03-30 09:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c12f9e0b-9387-51f0-baf1-ff760cedceb2, identifier: GR65234
2026-03-30 09:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c12f9e0b-9387-51f0-baf1-ff760cedceb2 with identifier: GR65234
2026-03-30 09:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c12f9e0b-9387-51f0-baf1-ff760cedceb2 with identifier: GR65234
2026-03-30 09:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c12f9e0b-9387-51f0-baf1-ff760cedceb2 with identifier: GR65234 to the API
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:51:26Z',
 'fuel_type': 'petrol',
 'id': 'c12f9e0b-9387-51f0-baf1-ff760cedceb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR65234',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 167204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-12-21',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2000}
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR65234%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [auto1.it] INFO: Saving data for GR65234: {'auction_closing_time': 1774885886.0, 'created_time': 1774267256.058823, 'last_price_update_time': 1774861795.632143}
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GR65234') HTTP/1.1" 204 0
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: EV67651
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: RT31033
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: ZX88730
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX88730%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [auto1.it] INFO: Scrape type for ZX88730: 2
2026-03-30 09:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cf65c1c-43a5-58fa-b154-7de40e2cbf25 with identifier: ZX88730
2026-03-30 09:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cf65c1c-43a5-58fa-b154-7de40e2cbf25 with scrape type 2
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cf65c1c-43a5-58fa-b154-7de40e2cbf25 with scrape type 2
2026-03-30 09:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7cf65c1c-43a5-58fa-b154-7de40e2cbf25, identifier: ZX88730
2026-03-30 09:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7cf65c1c-43a5-58fa-b154-7de40e2cbf25 with identifier: ZX88730
2026-03-30 09:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7cf65c1c-43a5-58fa-b154-7de40e2cbf25 with identifier: ZX88730
2026-03-30 09:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7cf65c1c-43a5-58fa-b154-7de40e2cbf25 with identifier: ZX88730 to the API
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:56:56Z',
 'fuel_type': 'diesel',
 'id': '7cf65c1c-43a5-58fa-b154-7de40e2cbf25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX88730',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 202413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-27',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX88730%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Saving data for ZX88730: {'auction_closing_time': 1774886216.0, 'created_time': 1773759710.560981, 'last_price_update_time': 1774861796.063073}
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZX88730') HTTP/1.1" 204 0
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: DA14696
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: GY24745
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: BT51990
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT51990%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Scrape type for BT51990: 0
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: BX71767
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: KR27714
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: NY71286
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: LN65398
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: HR92713
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR92713%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Scrape type for HR92713: 0
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: ZF40554
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF40554%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Scrape type for ZF40554: 0
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: MK90568
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK90568%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Scrape type for MK90568: 0
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: SX13991
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX13991%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Scrape type for SX13991: 0
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: FU47372
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU47372%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Scrape type for FU47372: 0
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: FG90237
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG90237%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Scrape type for FG90237: 0
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: FF25963
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: NT36373
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: MK89859
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: EU08042
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: RT93241
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: VS63057
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS63057%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Scrape type for VS63057: 0
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: TT73216
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: DM50235
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: XY06195
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY06195%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Scrape type for XY06195: 2
2026-03-30 09:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71852517-f20a-5132-a337-f7ea75147283 with identifier: XY06195
2026-03-30 09:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71852517-f20a-5132-a337-f7ea75147283 with scrape type 2
2026-03-30 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71852517-f20a-5132-a337-f7ea75147283 with scrape type 2
2026-03-30 09:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 71852517-f20a-5132-a337-f7ea75147283, identifier: XY06195
2026-03-30 09:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 71852517-f20a-5132-a337-f7ea75147283 with identifier: XY06195
2026-03-30 09:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 71852517-f20a-5132-a337-f7ea75147283 with identifier: XY06195
2026-03-30 09:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 71852517-f20a-5132-a337-f7ea75147283 with identifier: XY06195 to the API
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:07:29Z',
 'fuel_type': 'petrol',
 'id': '71852517-f20a-5132-a337-f7ea75147283',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY06195',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 37453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-30',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 e-VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY06195%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Saving data for XY06195: {'auction_closing_time': 1774883249.0, 'created_time': 1774645590.549786, 'last_price_update_time': 1774861796.737702}
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XY06195') HTTP/1.1" 204 0
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: KB99828
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB99828%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Scrape type for KB99828: 0
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: AP47784
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: ER28485
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: WL39771
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: WY52867
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY52867%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Scrape type for WY52867: 2
2026-03-30 09:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b5adc42-7faf-5803-9359-d9bef30c01f4 with identifier: WY52867
2026-03-30 09:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b5adc42-7faf-5803-9359-d9bef30c01f4 with scrape type 2
2026-03-30 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b5adc42-7faf-5803-9359-d9bef30c01f4 with scrape type 2
2026-03-30 09:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9b5adc42-7faf-5803-9359-d9bef30c01f4, identifier: WY52867
2026-03-30 09:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9b5adc42-7faf-5803-9359-d9bef30c01f4 with identifier: WY52867
2026-03-30 09:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9b5adc42-7faf-5803-9359-d9bef30c01f4 with identifier: WY52867
2026-03-30 09:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9b5adc42-7faf-5803-9359-d9bef30c01f4 with identifier: WY52867 to the API
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:15:54Z',
 'fuel_type': 'diesel',
 'id': '9b5adc42-7faf-5803-9359-d9bef30c01f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY52867',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 139701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-31',
 'seller_name': None,
 'title': 'Fiat Panda 1.3 JTD Climbing 4x4',
 'transmission': 'manual',
 'trim': 'Climbing 4x4',
 'year': 2011}
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY52867%27 HTTP/1.1" 200 None
2026-03-30 09:09:57 [auto1.it] INFO: Saving data for WY52867: {'auction_closing_time': 1774883754.0, 'created_time': 1774645574.660113, 'last_price_update_time': 1774861797.26825}
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WY52867') HTTP/1.1" 204 0
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: RE49156
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE49156%27 HTTP/1.1" 200 None
2026-03-30 09:09:57 [auto1.it] INFO: Scrape type for RE49156: 0
2026-03-30 09:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:57 [auto1.it] INFO: Channel: 24h | Page: 67 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: GB11317
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB11317%27 HTTP/1.1" 200 None
2026-03-30 09:09:57 [auto1.it] INFO: Scrape type for GB11317: 0
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: SS74594
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: YR57836
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: ZY29551
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY29551%27 HTTP/1.1" 200 None
2026-03-30 09:09:57 [auto1.it] INFO: Scrape type for ZY29551: 0
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: VB10041
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: VS88689
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: MH63316
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: KE74592
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE74592%27 HTTP/1.1" 200 None
2026-03-30 09:09:57 [auto1.it] INFO: Scrape type for KE74592: 2
2026-03-30 09:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d01551d2-c7d6-5155-bcff-b2282bc97a34 with identifier: KE74592
2026-03-30 09:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d01551d2-c7d6-5155-bcff-b2282bc97a34 with scrape type 2
2026-03-30 09:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d01551d2-c7d6-5155-bcff-b2282bc97a34 with scrape type 2
2026-03-30 09:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d01551d2-c7d6-5155-bcff-b2282bc97a34, identifier: KE74592
2026-03-30 09:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d01551d2-c7d6-5155-bcff-b2282bc97a34 with identifier: KE74592
2026-03-30 09:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d01551d2-c7d6-5155-bcff-b2282bc97a34 with identifier: KE74592
2026-03-30 09:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d01551d2-c7d6-5155-bcff-b2282bc97a34 with identifier: KE74592 to the API
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:24:05Z',
 'fuel_type': 'diesel',
 'id': 'd01551d2-c7d6-5155-bcff-b2282bc97a34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE74592',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 156878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-12',
 'seller_name': None,
 'title': 'BMW 2er 220d Active Tourer xDrive Basis',
 'transmission': 'automatic',
 'trim': 'xDrive Basis',
 'year': 2015}
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE74592%27 HTTP/1.1" 200 None
2026-03-30 09:09:58 [auto1.it] INFO: Saving data for KE74592: {'auction_closing_time': 1774884245.0, 'created_time': 1773435671.024872, 'last_price_update_time': 1774861798.448999}
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KE74592') HTTP/1.1" 204 0
2026-03-30 09:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:58 [auto1.it] INFO: Found listing with ID: NE32372
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE32372%27 HTTP/1.1" 200 None
2026-03-30 09:09:58 [auto1.it] INFO: Scrape type for NE32372: 0
2026-03-30 09:09:58 [auto1.it] INFO: Found listing with ID: WG36727
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG36727%27 HTTP/1.1" 200 None
2026-03-30 09:09:58 [auto1.it] INFO: Scrape type for WG36727: 0
2026-03-30 09:09:58 [auto1.it] INFO: Found listing with ID: AA65111
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA65111%27 HTTP/1.1" 200 None
2026-03-30 09:09:58 [auto1.it] INFO: Scrape type for AA65111: 2
2026-03-30 09:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 456d7376-f336-5355-89d9-9335a45bcc29 with identifier: AA65111
2026-03-30 09:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 456d7376-f336-5355-89d9-9335a45bcc29 with scrape type 2
2026-03-30 09:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 456d7376-f336-5355-89d9-9335a45bcc29 with scrape type 2
2026-03-30 09:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 456d7376-f336-5355-89d9-9335a45bcc29, identifier: AA65111
2026-03-30 09:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 456d7376-f336-5355-89d9-9335a45bcc29 with identifier: AA65111
2026-03-30 09:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 456d7376-f336-5355-89d9-9335a45bcc29 with identifier: AA65111
2026-03-30 09:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 456d7376-f336-5355-89d9-9335a45bcc29 with identifier: AA65111 to the API
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:57:42Z',
 'fuel_type': 'diesel',
 'id': '456d7376-f336-5355-89d9-9335a45bcc29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA65111',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 211743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-27',
 'seller_name': None,
 'title': 'Maserati Levante 3.0 V6 Diesel GranLusso',
 'transmission': 'automatic',
 'trim': 'GranLusso',
 'year': 2021}
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA65111%27 HTTP/1.1" 200 None
2026-03-30 09:09:59 [auto1.it] INFO: Saving data for AA65111: {'auction_closing_time': 1774886262.0, 'created_time': 1774645696.519836, 'last_price_update_time': 1774861799.079749}
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AA65111') HTTP/1.1" 204 0
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: FG22478
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: FD53627
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: UE69721
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: RZ31848
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ31848%27 HTTP/1.1" 200 None
2026-03-30 09:09:59 [auto1.it] INFO: Scrape type for RZ31848: 2
2026-03-30 09:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eded0fd-58d4-5034-8fed-e98f7029c86c with identifier: RZ31848
2026-03-30 09:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eded0fd-58d4-5034-8fed-e98f7029c86c with scrape type 2
2026-03-30 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0eded0fd-58d4-5034-8fed-e98f7029c86c with scrape type 2
2026-03-30 09:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0eded0fd-58d4-5034-8fed-e98f7029c86c, identifier: RZ31848
2026-03-30 09:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0eded0fd-58d4-5034-8fed-e98f7029c86c with identifier: RZ31848
2026-03-30 09:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0eded0fd-58d4-5034-8fed-e98f7029c86c with identifier: RZ31848
2026-03-30 09:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0eded0fd-58d4-5034-8fed-e98f7029c86c with identifier: RZ31848 to the API
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:27:46Z',
 'fuel_type': 'petrol',
 'id': '0eded0fd-58d4-5034-8fed-e98f7029c86c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ31848',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 175574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-27',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2017}
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ31848%27 HTTP/1.1" 200 None
2026-03-30 09:09:59 [auto1.it] INFO: Saving data for RZ31848: {'auction_closing_time': 1774884466.0, 'created_time': 1773846038.867071, 'last_price_update_time': 1774861799.458467}
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RZ31848') HTTP/1.1" 204 0
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: XH35372
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: NY14439
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: YG79824
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG79824%27 HTTP/1.1" 200 None
2026-03-30 09:09:59 [auto1.it] INFO: Scrape type for YG79824: 0
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: FA25945
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: TP79080
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP79080%27 HTTP/1.1" 200 None
2026-03-30 09:09:59 [auto1.it] INFO: Scrape type for TP79080: 0
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: JC61958
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC61958%27 HTTP/1.1" 200 None
2026-03-30 09:09:59 [auto1.it] INFO: Scrape type for JC61958: 2
2026-03-30 09:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc7eaca-7a36-52f8-8dd9-b4883c9d7c45 with identifier: JC61958
2026-03-30 09:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc7eaca-7a36-52f8-8dd9-b4883c9d7c45 with scrape type 2
2026-03-30 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbc7eaca-7a36-52f8-8dd9-b4883c9d7c45 with scrape type 2
2026-03-30 09:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbc7eaca-7a36-52f8-8dd9-b4883c9d7c45, identifier: JC61958
2026-03-30 09:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbc7eaca-7a36-52f8-8dd9-b4883c9d7c45 with identifier: JC61958
2026-03-30 09:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbc7eaca-7a36-52f8-8dd9-b4883c9d7c45 with identifier: JC61958
2026-03-30 09:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bbc7eaca-7a36-52f8-8dd9-b4883c9d7c45 with identifier: JC61958 to the API
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:37:19Z',
 'fuel_type': 'diesel',
 'id': 'bbc7eaca-7a36-52f8-8dd9-b4883c9d7c45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC61958',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 226032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC61958%27 HTTP/1.1" 200 None
2026-03-30 09:09:59 [auto1.it] INFO: Saving data for JC61958: {'auction_closing_time': 1774885039.0, 'created_time': 1773749394.328611, 'last_price_update_time': 1774861799.881658}
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JC61958') HTTP/1.1" 204 0
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: VV53069
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV53069%27 HTTP/1.1" 200 None
2026-03-30 09:10:00 [auto1.it] INFO: Scrape type for VV53069: 2
2026-03-30 09:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3df12ab8-6a23-54f9-9890-400e6ba98331 with identifier: VV53069
2026-03-30 09:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3df12ab8-6a23-54f9-9890-400e6ba98331 with scrape type 2
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3df12ab8-6a23-54f9-9890-400e6ba98331 with scrape type 2
2026-03-30 09:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3df12ab8-6a23-54f9-9890-400e6ba98331, identifier: VV53069
2026-03-30 09:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3df12ab8-6a23-54f9-9890-400e6ba98331 with identifier: VV53069
2026-03-30 09:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3df12ab8-6a23-54f9-9890-400e6ba98331 with identifier: VV53069
2026-03-30 09:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3df12ab8-6a23-54f9-9890-400e6ba98331 with identifier: VV53069 to the API
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:10:23Z',
 'fuel_type': 'diesel',
 'id': '3df12ab8-6a23-54f9-9890-400e6ba98331',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV53069',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 140289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-27',
 'seller_name': None,
 'title': 'Jeep Compass 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2019}
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV53069%27 HTTP/1.1" 200 None
2026-03-30 09:10:00 [auto1.it] INFO: Saving data for VV53069: {'auction_closing_time': 1774883423.0, 'created_time': 1774558954.884348, 'last_price_update_time': 1774861800.446044}
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VV53069') HTTP/1.1" 204 0
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: ZW88781
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: EX36920
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX36920%27 HTTP/1.1" 200 None
2026-03-30 09:10:00 [auto1.it] INFO: Scrape type for EX36920: 0
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: RC55633
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: ZL56801
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: DD75867
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD75867%27 HTTP/1.1" 200 None
2026-03-30 09:10:00 [auto1.it] INFO: Scrape type for DD75867: 2
2026-03-30 09:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ccfb1d-f95e-55ce-a4c7-0259b5468183 with identifier: DD75867
2026-03-30 09:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ccfb1d-f95e-55ce-a4c7-0259b5468183 with scrape type 2
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46ccfb1d-f95e-55ce-a4c7-0259b5468183 with scrape type 2
2026-03-30 09:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 46ccfb1d-f95e-55ce-a4c7-0259b5468183, identifier: DD75867
2026-03-30 09:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 46ccfb1d-f95e-55ce-a4c7-0259b5468183 with identifier: DD75867
2026-03-30 09:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 46ccfb1d-f95e-55ce-a4c7-0259b5468183 with identifier: DD75867
2026-03-30 09:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 46ccfb1d-f95e-55ce-a4c7-0259b5468183 with identifier: DD75867 to the API
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:57:49Z',
 'fuel_type': 'petrol',
 'id': '46ccfb1d-f95e-55ce-a4c7-0259b5468183',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD75867',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 233781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-13',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Spirit 4WD',
 'transmission': 'automatic',
 'trim': 'Spirit 4WD',
 'year': 2011}
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD75867%27 HTTP/1.1" 200 None
2026-03-30 09:10:00 [auto1.it] INFO: Saving data for DD75867: {'auction_closing_time': 1774886269.0, 'created_time': 1774645686.207868, 'last_price_update_time': 1774861800.866481}
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DD75867') HTTP/1.1" 204 0
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: FN89798
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: ZU32516
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: YY37168
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: MK47318
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK47318%27 HTTP/1.1" 200 None
2026-03-30 09:10:00 [auto1.it] INFO: Scrape type for MK47318: 2
2026-03-30 09:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ce6d1e1-94ca-525f-98ea-6986e3ccecd7 with identifier: MK47318
2026-03-30 09:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ce6d1e1-94ca-525f-98ea-6986e3ccecd7 with scrape type 2
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ce6d1e1-94ca-525f-98ea-6986e3ccecd7 with scrape type 2
2026-03-30 09:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ce6d1e1-94ca-525f-98ea-6986e3ccecd7, identifier: MK47318
2026-03-30 09:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ce6d1e1-94ca-525f-98ea-6986e3ccecd7 with identifier: MK47318
2026-03-30 09:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ce6d1e1-94ca-525f-98ea-6986e3ccecd7 with identifier: MK47318
2026-03-30 09:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ce6d1e1-94ca-525f-98ea-6986e3ccecd7 with identifier: MK47318 to the API
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:30:43Z',
 'fuel_type': 'diesel',
 'id': '8ce6d1e1-94ca-525f-98ea-6986e3ccecd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK47318',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 80615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-27',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK47318%27 HTTP/1.1" 200 None
2026-03-30 09:10:01 [auto1.it] INFO: Saving data for MK47318: {'auction_closing_time': 1774884643.0, 'created_time': 1774645600.519645, 'last_price_update_time': 1774861801.260912}
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MK47318') HTTP/1.1" 204 0
2026-03-30 09:10:01 [auto1.it] INFO: Found listing with ID: PW61851
2026-03-30 09:10:01 [auto1.it] INFO: Found listing with ID: DF71809
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF71809%27 HTTP/1.1" 200 None
2026-03-30 09:10:01 [auto1.it] INFO: Scrape type for DF71809: 0
2026-03-30 09:10:01 [auto1.it] INFO: Found listing with ID: PN84990
2026-03-30 09:10:01 [auto1.it] INFO: Found listing with ID: JT10117
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT10117%27 HTTP/1.1" 200 None
2026-03-30 09:10:01 [auto1.it] INFO: Scrape type for JT10117: 0
2026-03-30 09:10:01 [auto1.it] INFO: Found listing with ID: EV28185
2026-03-30 09:10:01 [auto1.it] INFO: Found listing with ID: UH10100
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH10100%27 HTTP/1.1" 200 None
2026-03-30 09:10:01 [auto1.it] INFO: Scrape type for UH10100: 2
2026-03-30 09:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 142fc6b0-153e-5620-906d-0faf2b123eba with identifier: UH10100
2026-03-30 09:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 142fc6b0-153e-5620-906d-0faf2b123eba with scrape type 2
2026-03-30 09:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 142fc6b0-153e-5620-906d-0faf2b123eba with scrape type 2
2026-03-30 09:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 142fc6b0-153e-5620-906d-0faf2b123eba, identifier: UH10100
2026-03-30 09:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 142fc6b0-153e-5620-906d-0faf2b123eba with identifier: UH10100
2026-03-30 09:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 142fc6b0-153e-5620-906d-0faf2b123eba with identifier: UH10100
2026-03-30 09:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 142fc6b0-153e-5620-906d-0faf2b123eba with identifier: UH10100 to the API
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:04:47Z',
 'fuel_type': 'diesel',
 'id': '142fc6b0-153e-5620-906d-0faf2b123eba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH10100',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 191496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-29',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2013}
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH10100%27 HTTP/1.1" 200 None
2026-03-30 09:10:01 [auto1.it] INFO: Saving data for UH10100: {'auction_closing_time': 1774883087.0, 'created_time': 1772105071.574371, 'last_price_update_time': 1774861801.748636}
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UH10100') HTTP/1.1" 204 0
2026-03-30 09:10:01 [auto1.it] INFO: Found listing with ID: MG40784
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG40784%27 HTTP/1.1" 200 None
2026-03-30 09:10:01 [auto1.it] INFO: Scrape type for MG40784: 0
2026-03-30 09:10:01 [auto1.it] INFO: Found listing with ID: YX40722
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX40722%27 HTTP/1.1" 200 None
2026-03-30 09:10:01 [auto1.it] INFO: Scrape type for YX40722: 2
2026-03-30 09:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1877b170-12d6-513e-a5db-3e69b511e303 with identifier: YX40722
2026-03-30 09:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1877b170-12d6-513e-a5db-3e69b511e303 with scrape type 2
2026-03-30 09:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1877b170-12d6-513e-a5db-3e69b511e303 with scrape type 2
2026-03-30 09:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1877b170-12d6-513e-a5db-3e69b511e303, identifier: YX40722
2026-03-30 09:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1877b170-12d6-513e-a5db-3e69b511e303 with identifier: YX40722
2026-03-30 09:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1877b170-12d6-513e-a5db-3e69b511e303 with identifier: YX40722
2026-03-30 09:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1877b170-12d6-513e-a5db-3e69b511e303 with identifier: YX40722 to the API
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:52:20Z',
 'fuel_type': 'diesel',
 'id': '1877b170-12d6-513e-a5db-3e69b511e303',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX40722',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 325809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-04',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2009}
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX40722%27 HTTP/1.1" 200 None
2026-03-30 09:10:02 [auto1.it] INFO: Saving data for YX40722: {'auction_closing_time': 1774885940.0, 'created_time': 1774559032.316725, 'last_price_update_time': 1774861802.315252}
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YX40722') HTTP/1.1" 204 0
2026-03-30 09:10:02 [auto1.it] INFO: Found listing with ID: HW99269
2026-03-30 09:10:02 [auto1.it] INFO: Channel: 24h | Page: 68 | totalHits: 3307 | hits on page: 40
2026-03-30 09:10:02 [auto1.it] INFO: Found listing with ID: XV92434
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV92434%27 HTTP/1.1" 200 None
2026-03-30 09:10:02 [auto1.it] INFO: Scrape type for XV92434: 0
2026-03-30 09:10:02 [auto1.it] INFO: Found listing with ID: KW23650
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW23650%27 HTTP/1.1" 200 None
2026-03-30 09:10:02 [auto1.it] INFO: Scrape type for KW23650: 2
2026-03-30 09:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 935c2bd8-257a-5d5d-ab08-02c80f5f2c88 with identifier: KW23650
2026-03-30 09:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 935c2bd8-257a-5d5d-ab08-02c80f5f2c88 with scrape type 2
2026-03-30 09:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 935c2bd8-257a-5d5d-ab08-02c80f5f2c88 with scrape type 2
2026-03-30 09:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 935c2bd8-257a-5d5d-ab08-02c80f5f2c88, identifier: KW23650
2026-03-30 09:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 935c2bd8-257a-5d5d-ab08-02c80f5f2c88 with identifier: KW23650
2026-03-30 09:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 935c2bd8-257a-5d5d-ab08-02c80f5f2c88 with identifier: KW23650
2026-03-30 09:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 935c2bd8-257a-5d5d-ab08-02c80f5f2c88 with identifier: KW23650 to the API
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:11:24Z',
 'fuel_type': 'diesel',
 'id': '935c2bd8-257a-5d5d-ab08-02c80f5f2c88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW23650',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Freemont',
 'odometer': 173681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-22',
 'seller_name': None,
 'title': 'Fiat Freemont 2.0 Multijet Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2012}
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW23650%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [auto1.it] INFO: Saving data for KW23650: {'auction_closing_time': 1774883484.0, 'created_time': 1773327969.564566, 'last_price_update_time': 1774861803.147055}
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KW23650') HTTP/1.1" 204 0
2026-03-30 09:10:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: RE73183
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE73183%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [auto1.it] INFO: Scrape type for RE73183: 0
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: EU31713
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU31713%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [auto1.it] INFO: Scrape type for EU31713: 2
2026-03-30 09:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b5aa989-86a6-5f27-8051-ed7686d9ce7e with identifier: EU31713
2026-03-30 09:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b5aa989-86a6-5f27-8051-ed7686d9ce7e with scrape type 2
2026-03-30 09:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b5aa989-86a6-5f27-8051-ed7686d9ce7e with scrape type 2
2026-03-30 09:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0b5aa989-86a6-5f27-8051-ed7686d9ce7e, identifier: EU31713
2026-03-30 09:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0b5aa989-86a6-5f27-8051-ed7686d9ce7e with identifier: EU31713
2026-03-30 09:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0b5aa989-86a6-5f27-8051-ed7686d9ce7e with identifier: EU31713
2026-03-30 09:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0b5aa989-86a6-5f27-8051-ed7686d9ce7e with identifier: EU31713 to the API
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:37:58Z',
 'fuel_type': 'diesel',
 'id': '0b5aa989-86a6-5f27-8051-ed7686d9ce7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU31713',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 114334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-23',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 V6 TDI HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2015}
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU31713%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [auto1.it] INFO: Saving data for EU31713: {'auction_closing_time': 1774885078.0, 'created_time': 1774558864.07276, 'last_price_update_time': 1774861803.614522}
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU31713') HTTP/1.1" 204 0
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: EK96047
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: SN24706
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN24706%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [auto1.it] INFO: Scrape type for SN24706: 0
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: CT94493
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: HW38972
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: XW45727
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: NV14531
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV14531%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [auto1.it] INFO: Scrape type for NV14531: 0
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: EA99644
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: WJ96008
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: KM03539
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM03539%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [auto1.it] INFO: Scrape type for KM03539: 2
2026-03-30 09:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87f85031-bb0e-5d82-a9e9-56837bc55076 with identifier: KM03539
2026-03-30 09:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f85031-bb0e-5d82-a9e9-56837bc55076 with scrape type 2
2026-03-30 09:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87f85031-bb0e-5d82-a9e9-56837bc55076 with scrape type 2
2026-03-30 09:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 87f85031-bb0e-5d82-a9e9-56837bc55076, identifier: KM03539
2026-03-30 09:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 87f85031-bb0e-5d82-a9e9-56837bc55076 with identifier: KM03539
2026-03-30 09:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 87f85031-bb0e-5d82-a9e9-56837bc55076 with identifier: KM03539
2026-03-30 09:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 87f85031-bb0e-5d82-a9e9-56837bc55076 with identifier: KM03539 to the API
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:21:10Z',
 'fuel_type': 'diesel',
 'id': '87f85031-bb0e-5d82-a9e9-56837bc55076',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM03539',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 293020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-31',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2011}
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM03539%27 HTTP/1.1" 200 None
2026-03-30 09:10:04 [auto1.it] INFO: Saving data for KM03539: {'auction_closing_time': 1774884070.0, 'created_time': 1773327878.741775, 'last_price_update_time': 1774861804.085497}
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM03539') HTTP/1.1" 204 0
2026-03-30 09:10:04 [auto1.it] INFO: Found listing with ID: SD99760
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD99760%27 HTTP/1.1" 200 None
2026-03-30 09:10:04 [auto1.it] INFO: Scrape type for SD99760: 2
2026-03-30 09:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae870a51-8328-5a77-9114-4edcba873cc7 with identifier: SD99760
2026-03-30 09:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae870a51-8328-5a77-9114-4edcba873cc7 with scrape type 2
2026-03-30 09:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae870a51-8328-5a77-9114-4edcba873cc7 with scrape type 2
2026-03-30 09:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ae870a51-8328-5a77-9114-4edcba873cc7, identifier: SD99760
2026-03-30 09:10:04 [scrapy.extensions.logstats] INFO: Crawled 300 pages (at 12 pages/min), scraped 731 items (at 79 items/min)
2026-03-30 09:10:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 198MiB
2026-03-30 09:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ae870a51-8328-5a77-9114-4edcba873cc7 with identifier: SD99760
2026-03-30 09:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ae870a51-8328-5a77-9114-4edcba873cc7 with identifier: SD99760
2026-03-30 09:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ae870a51-8328-5a77-9114-4edcba873cc7 with identifier: SD99760 to the API
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:19:56Z',
 'fuel_type': 'petrol',
 'id': 'ae870a51-8328-5a77-9114-4edcba873cc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD99760',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 118434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-06-27',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2002}
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD99760%27 HTTP/1.1" 200 None
2026-03-30 09:10:04 [auto1.it] INFO: Saving data for SD99760: {'auction_closing_time': 1774883996.0, 'created_time': 1774645662.499402, 'last_price_update_time': 1774861804.577914}
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SD99760') HTTP/1.1" 204 0
2026-03-30 09:10:04 [auto1.it] INFO: Found listing with ID: NH43496
2026-03-30 09:10:04 [auto1.it] INFO: Found listing with ID: LR80545
2026-03-30 09:10:04 [auto1.it] INFO: Found listing with ID: ST06974
2026-03-30 09:10:04 [auto1.it] INFO: Found listing with ID: YA38395
2026-03-30 09:10:04 [auto1.it] INFO: Found listing with ID: UV23225
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV23225%27 HTTP/1.1" 200 None
2026-03-30 09:10:04 [auto1.it] INFO: Scrape type for UV23225: 2
2026-03-30 09:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c316f3e0-4c99-5b1e-aaad-8bfb20f0a4bf with identifier: UV23225
2026-03-30 09:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c316f3e0-4c99-5b1e-aaad-8bfb20f0a4bf with scrape type 2
2026-03-30 09:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c316f3e0-4c99-5b1e-aaad-8bfb20f0a4bf with scrape type 2
2026-03-30 09:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c316f3e0-4c99-5b1e-aaad-8bfb20f0a4bf, identifier: UV23225
2026-03-30 09:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c316f3e0-4c99-5b1e-aaad-8bfb20f0a4bf with identifier: UV23225
2026-03-30 09:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c316f3e0-4c99-5b1e-aaad-8bfb20f0a4bf with identifier: UV23225
2026-03-30 09:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c316f3e0-4c99-5b1e-aaad-8bfb20f0a4bf with identifier: UV23225 to the API
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:33:25Z',
 'fuel_type': 'diesel',
 'id': 'c316f3e0-4c99-5b1e-aaad-8bfb20f0a4bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV23225',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 114306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'BMW 2er 216d Active Tourer',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV23225%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [auto1.it] INFO: Saving data for UV23225: {'auction_closing_time': 1774884805.0, 'created_time': 1774342871.616293, 'last_price_update_time': 1774861805.040924}
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UV23225') HTTP/1.1" 204 0
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: AF86061
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: HA74709
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA74709%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [auto1.it] INFO: Scrape type for HA74709: 0
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: HH71659
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: JD36680
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: XW11581
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: SM56678
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM56678%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [auto1.it] INFO: Scrape type for SM56678: 0
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: FV08764
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: ZP43872
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP43872%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [auto1.it] INFO: Scrape type for ZP43872: 0
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: NT87512
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT87512%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [auto1.it] INFO: Scrape type for NT87512: 0
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: HK76451
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: BR85251
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: MJ56549
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: JZ41811
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ41811%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [auto1.it] INFO: Scrape type for JZ41811: 0
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: GT53480
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: RF78298
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: FE23339
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE23339%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [auto1.it] INFO: Scrape type for FE23339: 0
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: CN60691
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: ZA31579
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA31579%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [auto1.it] INFO: Scrape type for ZA31579: 0
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: CM50151
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM50151%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [auto1.it] INFO: Scrape type for CM50151: 2
2026-03-30 09:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e1b898-a0a5-5b49-aa1b-45477cff77a2 with identifier: CM50151
2026-03-30 09:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e1b898-a0a5-5b49-aa1b-45477cff77a2 with scrape type 2
2026-03-30 09:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57e1b898-a0a5-5b49-aa1b-45477cff77a2 with scrape type 2
2026-03-30 09:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57e1b898-a0a5-5b49-aa1b-45477cff77a2, identifier: CM50151
2026-03-30 09:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57e1b898-a0a5-5b49-aa1b-45477cff77a2 with identifier: CM50151
2026-03-30 09:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57e1b898-a0a5-5b49-aa1b-45477cff77a2 with identifier: CM50151
2026-03-30 09:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57e1b898-a0a5-5b49-aa1b-45477cff77a2 with identifier: CM50151 to the API
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:44:38Z',
 'fuel_type': 'diesel',
 'id': '57e1b898-a0a5-5b49-aa1b-45477cff77a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM50151',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 168877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-26',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM50151%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [auto1.it] INFO: Saving data for CM50151: {'auction_closing_time': 1774885478.0, 'created_time': 1774645645.475365, 'last_price_update_time': 1774861805.584719}
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CM50151') HTTP/1.1" 204 0
2026-03-30 09:10:06 [auto1.it] INFO: Found listing with ID: VG20766
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG20766%27 HTTP/1.1" 200 None
2026-03-30 09:10:06 [auto1.it] INFO: Scrape type for VG20766: 0
2026-03-30 09:10:06 [auto1.it] INFO: Found listing with ID: ZJ39070
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ39070%27 HTTP/1.1" 200 None
2026-03-30 09:10:06 [auto1.it] INFO: Scrape type for ZJ39070: 0
2026-03-30 09:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:08 [auto1.it] INFO: Channel: 24h | Page: 69 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: CM50151
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM50151%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for CM50151: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: VG20766
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG20766%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for VG20766: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: ZJ39070
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ39070%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for ZJ39070: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: AZ05187
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: NF08896
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: CD59495
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD59495%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for CD59495: 2
2026-03-30 09:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd2725f4-5b51-5a8e-8a20-93204addbb55 with identifier: CD59495
2026-03-30 09:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2725f4-5b51-5a8e-8a20-93204addbb55 with scrape type 2
2026-03-30 09:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd2725f4-5b51-5a8e-8a20-93204addbb55 with scrape type 2
2026-03-30 09:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd2725f4-5b51-5a8e-8a20-93204addbb55, identifier: CD59495
2026-03-30 09:10:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd2725f4-5b51-5a8e-8a20-93204addbb55 with identifier: CD59495
2026-03-30 09:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd2725f4-5b51-5a8e-8a20-93204addbb55 with identifier: CD59495
2026-03-30 09:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd2725f4-5b51-5a8e-8a20-93204addbb55 with identifier: CD59495 to the API
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:23:54Z',
 'fuel_type': 'diesel',
 'id': 'dd2725f4-5b51-5a8e-8a20-93204addbb55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD59495',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 182655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-26',
 'seller_name': None,
 'title': 'Audi Q5 Sportback 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD59495%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Saving data for CD59495: {'auction_closing_time': 1774884234.0, 'created_time': 1773392496.074241, 'last_price_update_time': 1774861808.757165}
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CD59495') HTTP/1.1" 204 0
2026-03-30 09:10:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: VY80184
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: PX04626
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: TH88339
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: ER97620
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: YW53472
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: HS43445
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: PH25620
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: DL31507
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: AD96495
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD96495%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for AD96495: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: YP66201
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP66201%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for YP66201: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: LN67507
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN67507%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for LN67507: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: GZ47839
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: AR03634
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: TL02319
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: XE78357
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: BW07837
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: MX32120
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX32120%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for MX32120: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: XZ55537
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ55537%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for XZ55537: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: FE63733
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: AK49270
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK49270%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for AK49270: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: TP02469
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP02469%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for TP02469: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: UC14598
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: RV10689
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV10689%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for RV10689: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: YV66151
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV66151%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for YV66151: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: NT18683
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT18683%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for NT18683: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: VH18457
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: PM85940
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: UK60459
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: XJ25634
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ25634%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for XJ25634: 0
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: TS00967
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS00967%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for TS00967: 0
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: CZ11807
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: HY82012
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: MY80647
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY80647%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for MY80647: 0
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: BC50392
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC50392%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for BC50392: 0
2026-03-30 09:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:09 [auto1.it] INFO: Channel: 24h | Page: 70 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: YD02421
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: RK76685
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK76685%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for RK76685: 0
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: HJ04810
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ04810%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for HJ04810: 0
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: MR30902
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR30902%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for MR30902: 0
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: JZ43112
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: EF18991
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF18991%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for EF18991: 0
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: PZ93263
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ93263%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for PZ93263: 0
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: YD31077
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD31077%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for YD31077: 0
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: WK47884
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: GR46256
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: KR62960
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR62960%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Scrape type for KR62960: 0
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: BP72871
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: MN05358
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: NX49735
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX49735%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Scrape type for NX49735: 0
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: RM50163
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM50163%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Scrape type for RM50163: 0
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: TH60548
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: JM95977
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM95977%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Scrape type for JM95977: 0
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: SC57434
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: WM09394
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM09394%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Scrape type for WM09394: 0
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: NH87827
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH87827%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Scrape type for NH87827: 0
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: EP52133
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: PY38952
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: GZ68257
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: CG38373
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: KN28324
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: SV68471
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV68471%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Scrape type for SV68471: 0
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: BH87833
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: NE29040
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: RK99012
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: NC22560
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: FC56913
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC56913%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Scrape type for FC56913: 0
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: VB76236
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: TJ16144
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ16144%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Scrape type for TJ16144: 0
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: MP38802
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: KV55907
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV55907%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Scrape type for KV55907: 0
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: BZ51177
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: CY56164
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: TB63135
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: ZK39903
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: KZ13497
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ13497%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Scrape type for KZ13497: 0
2026-03-30 09:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:11 [auto1.it] INFO: Channel: 24h | Page: 71 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: YX84472
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: AT73331
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT73331%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for AT73331: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: NW39959
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW39959%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for NW39959: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: YK98276
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: CJ64567
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ64567%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for CJ64567: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: FK78904
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: JC35817
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: MC76570
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: ZC44432
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC44432%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for ZC44432: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: BB49648
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB49648%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for BB49648: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: NC13614
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: GJ99640
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ99640%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for GJ99640: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: TT70902
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: ZG26295
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: CT59426
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: GK49763
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK49763%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for GK49763: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: EN63218
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: NM61203
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM61203%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for NM61203: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: PV47203
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: YE33932
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE33932%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for YE33932: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: JR36012
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR36012%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for JR36012: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: RS27725
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: XP44684
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: ML45383
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: LJ23422
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ23422%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for LJ23422: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: YM04373
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM04373%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for YM04373: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: MZ65778
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ65778%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for MZ65778: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: TD58457
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD58457%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for TD58457: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: SB59466
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB59466%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for SB59466: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: BV17272
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV17272%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for BV17272: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: FE93281
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE93281%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for FE93281: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: EG33732
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG33732%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for EG33732: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: TR09676
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR09676%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for TR09676: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: SX65477
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: DA98342
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA98342%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for DA98342: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: HB00898
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB00898%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for HB00898: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: NF72135
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: XS00387
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: AR49211
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR49211%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for AR49211: 0
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: MD59623
2026-03-30 09:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:12 [auto1.it] INFO: Channel: 24h | Page: 72 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: RN27083
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: EZ67132
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ67132%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for EZ67132: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: RG18197
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG18197%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for RG18197: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: AW19697
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: UJ83864
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ83864%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for UJ83864: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: XM71615
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: AG42346
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG42346%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for AG42346: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: RR79025
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR79025%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for RR79025: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: AS99130
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS99130%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for AS99130: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: RH79013
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH79013%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for RH79013: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: JL18468
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL18468%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for JL18468: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: FP31020
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: AV18402
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV18402%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for AV18402: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: ZF99216
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: WF32010
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF32010%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for WF32010: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: XH74376
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH74376%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for XH74376: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: EC03156
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC03156%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for EC03156: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: PD98498
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: HJ07688
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: FF80511
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF80511%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for FF80511: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: UB92069
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB92069%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for UB92069: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: GU46238
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: GS36896
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: DK49031
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: MN68562
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN68562%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for MN68562: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: RR38006
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR38006%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for RR38006: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: UW74676
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: JZ66909
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ66909%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for JZ66909: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: EW77307
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW77307%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for EW77307: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: HJ48011
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: PJ71432
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ71432%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for PJ71432: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: HJ37635
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ37635%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for HJ37635: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: UM30654
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM30654%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for UM30654: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: HY25299
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY25299%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for HY25299: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: RG33241
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG33241%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for RG33241: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: ZT77518
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: KS29368
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: XS70804
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS70804%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for XS70804: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: EL95895
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL95895%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for EL95895: 0
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: XP33889
2026-03-30 09:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:13 [auto1.it] INFO: Channel: 24h | Page: 73 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: BS70853
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: PP81137
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: AB11915
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB11915%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [auto1.it] INFO: Scrape type for AB11915: 0
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: YT31818
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT31818%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [auto1.it] INFO: Scrape type for YT31818: 0
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: LK77946
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: CV06620
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: CP91888
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP91888%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [auto1.it] INFO: Scrape type for CP91888: 0
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: AT88859
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT88859%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [auto1.it] INFO: Scrape type for AT88859: 0
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: WR49596
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR49596%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [auto1.it] INFO: Scrape type for WR49596: 0
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: UT72595
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT72595%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [auto1.it] INFO: Scrape type for UT72595: 0
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: WU25072
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: XP46027
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: ZS74487
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: FP84024
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: HA91371
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: ZT94310
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: YB21046
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: GY17675
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: HR28952
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: CL50179
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: AV05178
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV05178%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [auto1.it] INFO: Scrape type for AV05178: 0
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: ZS11268
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS11268%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [auto1.it] INFO: Scrape type for ZS11268: 0
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: MR54744
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR54744%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [auto1.it] INFO: Scrape type for MR54744: 0
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: VD19319
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD19319%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [auto1.it] INFO: Scrape type for VD19319: 0
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: VR66407
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR66407%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [auto1.it] INFO: Scrape type for VR66407: 0
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: MH80667
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH80667%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [auto1.it] INFO: Scrape type for MH80667: 0
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: SH27035
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: AT94230
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: VZ01162
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: KL53293
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL53293%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [auto1.it] INFO: Scrape type for KL53293: 0
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: PC10788
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC10788%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [auto1.it] INFO: Scrape type for PC10788: 0
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: UK65211
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK65211%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [auto1.it] INFO: Scrape type for UK65211: 0
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: JP68462
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: PW02213
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: HK83461
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: YY73995
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: SA64006
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: CL59289
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: XG56779
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG56779%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [auto1.it] INFO: Scrape type for XG56779: 0
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: MM92729
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM92729%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [auto1.it] INFO: Scrape type for MM92729: 0
2026-03-30 09:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:16 [auto1.it] INFO: Channel: 24h | Page: 74 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: PN94511
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: SP64220
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP64220%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for SP64220: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: DC19091
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: CE88334
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE88334%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for CE88334: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: FP92305
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP92305%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for FP92305: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: WH54274
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH54274%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for WH54274: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: YA71285
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA71285%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for YA71285: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: ZZ46220
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: CW38322
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: LX63173
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX63173%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for LX63173: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: KV28875
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: RA59977
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: NF25875
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF25875%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for NF25875: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: KZ65568
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: WJ04614
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: GJ44194
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ44194%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for GJ44194: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: JK37550
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: ZJ54266
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: TU97067
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: NG25648
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG25648%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for NG25648: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: BR40244
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: DN16039
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN16039%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for DN16039: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: AV77078
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV77078%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for AV77078: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: WA78117
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: KJ64759
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ64759%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for KJ64759: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: DV92182
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: KS37590
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS37590%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for KS37590: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: SN56705
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: RK00703
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK00703%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for RK00703: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: KM72059
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM72059%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for KM72059: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: NL56799
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL56799%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for NL56799: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: CZ11346
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: ZV36877
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV36877%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for ZV36877: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: AW40388
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: UR17084
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR17084%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for UR17084: 0
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: DE71304
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: LA00570
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: ST97650
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: CD54959
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: ZH08694
2026-03-30 09:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:17 [auto1.it] INFO: Channel: 24h | Page: 75 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:17 [auto1.it] INFO: Found listing with ID: WN91380
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN91380%27 HTTP/1.1" 200 None
2026-03-30 09:10:17 [auto1.it] INFO: Scrape type for WN91380: 0
2026-03-30 09:10:17 [auto1.it] INFO: Found listing with ID: RT10721
2026-03-30 09:10:17 [auto1.it] INFO: Found listing with ID: XL68174
2026-03-30 09:10:17 [auto1.it] INFO: Found listing with ID: NR40821
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR40821%27 HTTP/1.1" 200 None
2026-03-30 09:10:17 [auto1.it] INFO: Scrape type for NR40821: 0
2026-03-30 09:10:17 [auto1.it] INFO: Found listing with ID: NR41367
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR41367%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for NR41367: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: DS09954
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS09954%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for DS09954: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: EF37813
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF37813%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for EF37813: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: CJ77239
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: BT82313
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: MN04958
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN04958%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for MN04958: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: LR68259
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR68259%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for LR68259: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: WB58416
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: CS61296
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: HA26837
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA26837%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for HA26837: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: JE63706
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE63706%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for JE63706: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: CN51839
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN51839%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for CN51839: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: JR85955
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR85955%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for JR85955: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: MC18601
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC18601%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for MC18601: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: JH97185
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH97185%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for JH97185: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: SY20877
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY20877%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for SY20877: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: KT14926
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: SD18580
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: TW38851
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW38851%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for TW38851: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: RM24928
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: DF57379
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: XB46951
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB46951%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for XB46951: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: VG07643
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG07643%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for VG07643: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: UN20093
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: UT21803
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: RC42052
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: YJ81563
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ81563%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for YJ81563: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: JF24469
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF24469%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for JF24469: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: VZ90962
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ90962%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for VZ90962: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: FR55532
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: BL56378
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: HF54587
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: AY76833
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: RJ05786
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ05786%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for RJ05786: 0
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: CV60870
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: PM98470
2026-03-30 09:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:19 [auto1.it] INFO: Channel: 24h | Page: 76 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: XT30792
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: HD11089
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD11089%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for HD11089: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: WM47642
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM47642%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for WM47642: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: KH13960
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH13960%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for KH13960: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: WS77593
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS77593%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for WS77593: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: KM48378
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: ET22397
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: TB64568
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: ZU99068
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: VL91397
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL91397%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for VL91397: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: WG77442
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG77442%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for WG77442: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: LE72169
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE72169%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for LE72169: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: UR17462
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR17462%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for UR17462: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: DU34377
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: EV59116
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV59116%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for EV59116: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: UY41081
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY41081%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for UY41081: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: YN18335
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN18335%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for YN18335: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: NA95464
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: WA05506
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: PW96424
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: CZ80815
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ80815%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for CZ80815: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: YT14499
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT14499%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for YT14499: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: BU30300
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU30300%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for BU30300: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: WE07120
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: NF75023
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF75023%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for NF75023: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: VZ92626
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: TF83722
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: BA01278
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: PW47751
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: CU74500
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: SB06120
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: VC50043
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC50043%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for VC50043: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: ZK25339
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: ZX07478
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX07478%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for ZX07478: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: VY27693
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: JZ77925
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: YY84618
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY84618%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for YY84618: 0
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: LN66513
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: CE47539
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: ET05908
2026-03-30 09:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:20 [auto1.it] INFO: Channel: 24h | Page: 77 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: YH77376
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH77376%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [auto1.it] INFO: Scrape type for YH77376: 0
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: YF75384
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: YP53845
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: MU44225
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU44225%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [auto1.it] INFO: Scrape type for MU44225: 0
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: DV89996
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: GC21308
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: WN69179
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: RT68139
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: GU07540
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: MJ56294
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: ND60676
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: RD34551
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD34551%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [auto1.it] INFO: Scrape type for RD34551: 0
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: MX89615
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX89615%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [auto1.it] INFO: Scrape type for MX89615: 0
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: DC79577
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC79577%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [auto1.it] INFO: Scrape type for DC79577: 0
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: FJ19911
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ19911%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [auto1.it] INFO: Scrape type for FJ19911: 0
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: DP83591
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: DF10030
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: RF53888
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: XC35499
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC35499%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for XC35499: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: KW13943
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW13943%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for KW13943: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: CK02940
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK02940%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for CK02940: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: NW63690
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW63690%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for NW63690: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: CR10860
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: RZ14942
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ14942%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for RZ14942: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: NE68522
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE68522%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for NE68522: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: HB76167
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB76167%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for HB76167: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: LW42205
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: JX99167
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX99167%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for JX99167: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: PB77964
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB77964%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for PB77964: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: PR01158
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: LU04143
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: VX06371
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX06371%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for VX06371: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: XU75020
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU75020%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for XU75020: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: RT78827
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT78827%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for RT78827: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: ZX02617
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: GF04401
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF04401%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for GF04401: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: LF71839
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: KV81214
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: NZ66288
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ66288%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for NZ66288: 0
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: LC50167
2026-03-30 09:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:23 [auto1.it] INFO: Channel: 24h | Page: 78 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: RB44165
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB44165%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for RB44165: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: KG10642
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG10642%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for KG10642: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: VU78996
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: JC58161
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC58161%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for JC58161: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: NB09244
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB09244%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for NB09244: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: CG41342
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG41342%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for CG41342: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: XC50936
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: PU47641
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU47641%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for PU47641: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: TV36442
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV36442%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for TV36442: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: YG59194
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG59194%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for YG59194: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: NZ89280
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: DV86201
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: MR47105
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR47105%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for MR47105: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: CP63934
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: WA70865
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA70865%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for WA70865: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: ZB75356
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB75356%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for ZB75356: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: SM49398
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: ND99251
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: RE64067
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE64067%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for RE64067: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: DE18860
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: BM48711
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM48711%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for BM48711: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: NH24051
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: LU93439
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: GC10643
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: HD89174
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD89174%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for HD89174: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: LL57465
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL57465%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for LL57465: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: SD35651
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD35651%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for SD35651: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: VJ26511
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: UM38141
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: XE84016
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE84016%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for XE84016: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: LD34697
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: NN91424
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN91424%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for NN91424: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: JP07987
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP07987%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for JP07987: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: ZM57231
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM57231%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for ZM57231: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: KG93031
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG93031%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for KG93031: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: PK33610
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: FL38609
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL38609%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for FL38609: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: PR73005
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: VU45167
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: YD14292
2026-03-30 09:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:25 [auto1.it] INFO: Channel: 24h | Page: 79 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: HC79760
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: YJ65230
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ65230%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for YJ65230: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: AY38539
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: FN08703
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: DK59825
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK59825%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for DK59825: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: SN64311
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN64311%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for SN64311: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: WA74903
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: NV36405
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV36405%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for NV36405: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: RX99129
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: EY62872
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: MT10040
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT10040%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for MT10040: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: DE88474
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE88474%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for DE88474: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: FC40925
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC40925%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for FC40925: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: LB90809
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB90809%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for LB90809: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: EU57494
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: EG76959
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: EW38815
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: RC51898
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: RL93891
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL93891%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for RL93891: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: EX32240
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: SC52671
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC52671%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for SC52671: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: ZD86423
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: FJ00600
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ00600%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for FJ00600: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: GD51545
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: HC77212
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC77212%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for HC77212: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: UD61440
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: EP46313
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: NB70789
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: ZF56836
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF56836%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for ZF56836: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: LS68308
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: LX14349
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX14349%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for LX14349: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: HU17700
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: XB86450
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB86450%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for XB86450: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: BC13106
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: SS75136
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: TZ08821
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ08821%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for TZ08821: 0
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: FW12151
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: SD66994
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: LB50046
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: NL74097
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL74097%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for NL74097: 0
2026-03-30 09:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:26 [auto1.it] INFO: Channel: 24h | Page: 80 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: ME27860
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME27860%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Scrape type for ME27860: 0
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: MX93098
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: CL75380
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL75380%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Scrape type for CL75380: 0
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: VK29965
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: WG00273
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: BX84836
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX84836%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Scrape type for BX84836: 0
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: ZH45027
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH45027%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Scrape type for ZH45027: 0
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: CD24058
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD24058%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Scrape type for CD24058: 0
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: VB56015
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: TV81460
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV81460%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Scrape type for TV81460: 0
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: RK78436
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: SX60727
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX60727%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Scrape type for SX60727: 0
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: SF25356
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF25356%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Scrape type for SF25356: 0
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: PB64949
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB64949%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Scrape type for PB64949: 0
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: HW36660
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: GX37056
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: HR61031
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: RU00933
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU00933%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Scrape type for RU00933: 0
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: SP24974
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: WU48756
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: PR17884
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR17884%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Scrape type for PR17884: 0
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: XP65023
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP65023%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [auto1.it] INFO: Scrape type for XP65023: 0
2026-03-30 09:10:27 [auto1.it] INFO: Found listing with ID: FV28373
2026-03-30 09:10:27 [auto1.it] INFO: Found listing with ID: BU89130
2026-03-30 09:10:27 [auto1.it] INFO: Found listing with ID: WM91137
2026-03-30 09:10:27 [auto1.it] INFO: Found listing with ID: JB83443
2026-03-30 09:10:27 [auto1.it] INFO: Found listing with ID: MR74044
2026-03-30 09:10:27 [auto1.it] INFO: Found listing with ID: PB47164
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB47164%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [auto1.it] INFO: Scrape type for PB47164: 2
2026-03-30 09:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbb1755c-dcc1-5901-ad6a-8691b825311c with identifier: PB47164
2026-03-30 09:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb1755c-dcc1-5901-ad6a-8691b825311c with scrape type 2
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbb1755c-dcc1-5901-ad6a-8691b825311c with scrape type 2
2026-03-30 09:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dbb1755c-dcc1-5901-ad6a-8691b825311c, identifier: PB47164
2026-03-30 09:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dbb1755c-dcc1-5901-ad6a-8691b825311c with identifier: PB47164
2026-03-30 09:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dbb1755c-dcc1-5901-ad6a-8691b825311c with identifier: PB47164
2026-03-30 09:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dbb1755c-dcc1-5901-ad6a-8691b825311c with identifier: PB47164 to the API
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:12:19Z',
 'fuel_type': 'petrol',
 'id': 'dbb1755c-dcc1-5901-ad6a-8691b825311c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB47164',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 213129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 B-Color',
 'transmission': 'manual',
 'trim': 'B-Color',
 'year': 2017}
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB47164%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [auto1.it] INFO: Saving data for PB47164: {'auction_closing_time': 1774883539.0, 'created_time': 1774688427.044509, 'last_price_update_time': 1774861827.650314}
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PB47164') HTTP/1.1" 204 0
2026-03-30 09:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:27 [auto1.it] INFO: Found listing with ID: RU74019
2026-03-30 09:10:27 [auto1.it] INFO: Found listing with ID: GT62268
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT62268%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [auto1.it] INFO: Scrape type for GT62268: 2
2026-03-30 09:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 215da4ae-ea25-5460-b688-baeacd31392c with identifier: GT62268
2026-03-30 09:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 215da4ae-ea25-5460-b688-baeacd31392c with scrape type 2
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 215da4ae-ea25-5460-b688-baeacd31392c with scrape type 2
2026-03-30 09:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 215da4ae-ea25-5460-b688-baeacd31392c, identifier: GT62268
2026-03-30 09:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 215da4ae-ea25-5460-b688-baeacd31392c with identifier: GT62268
2026-03-30 09:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 215da4ae-ea25-5460-b688-baeacd31392c with identifier: GT62268
2026-03-30 09:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 215da4ae-ea25-5460-b688-baeacd31392c with identifier: GT62268 to the API
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:44:44Z',
 'fuel_type': 'petrol',
 'id': '215da4ae-ea25-5460-b688-baeacd31392c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT62268',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 92908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-23',
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2021}
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT62268%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [auto1.it] INFO: Saving data for GT62268: {'auction_closing_time': 1774885484.0, 'created_time': 1774688434.222088, 'last_price_update_time': 1774861828.127476}
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GT62268') HTTP/1.1" 204 0
2026-03-30 09:10:28 [auto1.it] INFO: Found listing with ID: NY06096
2026-03-30 09:10:28 [auto1.it] INFO: Found listing with ID: DD11193
2026-03-30 09:10:28 [auto1.it] INFO: Found listing with ID: TU55073
2026-03-30 09:10:28 [auto1.it] INFO: Found listing with ID: JC52693
2026-03-30 09:10:28 [auto1.it] INFO: Found listing with ID: BA37529
2026-03-30 09:10:28 [auto1.it] INFO: Found listing with ID: PR63683
2026-03-30 09:10:28 [auto1.it] INFO: Found listing with ID: KC74563
2026-03-30 09:10:28 [auto1.it] INFO: Found listing with ID: JD73354
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD73354%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [auto1.it] INFO: Scrape type for JD73354: 2
2026-03-30 09:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5 with identifier: JD73354
2026-03-30 09:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5 with scrape type 2
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5 with scrape type 2
2026-03-30 09:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5, identifier: JD73354
2026-03-30 09:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5 with identifier: JD73354
2026-03-30 09:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5 with identifier: JD73354
2026-03-30 09:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 71fd0bc0-b942-5fc4-849b-935c3f7dc6e5 with identifier: JD73354 to the API
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:13:43Z',
 'fuel_type': 'diesel',
 'id': '71fd0bc0-b942-5fc4-849b-935c3f7dc6e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD73354',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 176577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-13',
 'seller_name': None,
 'title': 'Toyota Corolla 1.4 D-4D Compact',
 'transmission': 'automatic',
 'trim': 'Compact',
 'year': 2006}
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD73354%27 HTTP/1.1" 200 None
2026-03-30 09:10:29 [auto1.it] INFO: Saving data for JD73354: {'auction_closing_time': 1774883623.0, 'created_time': 1774688422.074593, 'last_price_update_time': 1774861829.238671}
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JD73354') HTTP/1.1" 204 0
2026-03-30 09:10:29 [auto1.it] INFO: Found listing with ID: MB22824
2026-03-30 09:10:29 [auto1.it] INFO: Found listing with ID: NW35507
2026-03-30 09:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:30 [auto1.it] INFO: Channel: 24h | Page: 81 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:30 [auto1.it] INFO: Found listing with ID: AG64342
2026-03-30 09:10:30 [auto1.it] INFO: Found listing with ID: RC92896
2026-03-30 09:10:30 [auto1.it] INFO: Found listing with ID: WK68121
2026-03-30 09:10:30 [auto1.it] INFO: Found listing with ID: MM70792
2026-03-30 09:10:30 [auto1.it] INFO: Found listing with ID: RF74009
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF74009%27 HTTP/1.1" 200 None
2026-03-30 09:10:30 [auto1.it] INFO: Scrape type for RF74009: 2
2026-03-30 09:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2f55222-a70a-5771-9dfb-4bcd638f3c9f with identifier: RF74009
2026-03-30 09:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f55222-a70a-5771-9dfb-4bcd638f3c9f with scrape type 2
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2f55222-a70a-5771-9dfb-4bcd638f3c9f with scrape type 2
2026-03-30 09:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a2f55222-a70a-5771-9dfb-4bcd638f3c9f, identifier: RF74009
2026-03-30 09:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a2f55222-a70a-5771-9dfb-4bcd638f3c9f with identifier: RF74009
2026-03-30 09:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a2f55222-a70a-5771-9dfb-4bcd638f3c9f with identifier: RF74009
2026-03-30 09:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a2f55222-a70a-5771-9dfb-4bcd638f3c9f with identifier: RF74009 to the API
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:36:08Z',
 'fuel_type': 'diesel',
 'id': 'a2f55222-a70a-5771-9dfb-4bcd638f3c9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF74009',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 34876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-04',
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend',
 'transmission': 'manual',
 'trim': 'Kasten Trend',
 'year': 2023}
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF74009%27 HTTP/1.1" 200 None
2026-03-30 09:10:30 [auto1.it] INFO: Saving data for RF74009: {'auction_closing_time': 1774884968.0, 'created_time': 1774342890.819331, 'last_price_update_time': 1774861830.654025}
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF74009') HTTP/1.1" 204 0
2026-03-30 09:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:30 [auto1.it] INFO: Found listing with ID: VP67579
2026-03-30 09:10:30 [auto1.it] INFO: Found listing with ID: FD11952
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD11952%27 HTTP/1.1" 200 None
2026-03-30 09:10:30 [auto1.it] INFO: Scrape type for FD11952: 0
2026-03-30 09:10:30 [auto1.it] INFO: Found listing with ID: VM60926
2026-03-30 09:10:30 [auto1.it] INFO: Found listing with ID: RY72509
2026-03-30 09:10:30 [auto1.it] INFO: Found listing with ID: UE94474
2026-03-30 09:10:30 [auto1.it] INFO: Found listing with ID: LG11591
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG11591%27 HTTP/1.1" 200 None
2026-03-30 09:10:30 [auto1.it] INFO: Scrape type for LG11591: 2
2026-03-30 09:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbab5590-197f-5160-b62f-f56d70110de0 with identifier: LG11591
2026-03-30 09:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbab5590-197f-5160-b62f-f56d70110de0 with scrape type 2
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbab5590-197f-5160-b62f-f56d70110de0 with scrape type 2
2026-03-30 09:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbab5590-197f-5160-b62f-f56d70110de0, identifier: LG11591
2026-03-30 09:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbab5590-197f-5160-b62f-f56d70110de0 with identifier: LG11591
2026-03-30 09:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbab5590-197f-5160-b62f-f56d70110de0 with identifier: LG11591
2026-03-30 09:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bbab5590-197f-5160-b62f-f56d70110de0 with identifier: LG11591 to the API
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:32:39Z',
 'fuel_type': 'petrol',
 'id': 'bbab5590-197f-5160-b62f-f56d70110de0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG11591',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 241422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2015}
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG11591%27 HTTP/1.1" 200 None
2026-03-30 09:10:31 [auto1.it] INFO: Saving data for LG11591: {'auction_closing_time': 1774884759.0, 'created_time': 1774688421.303635, 'last_price_update_time': 1774861831.552953}
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG11591') HTTP/1.1" 204 0
2026-03-30 09:10:31 [auto1.it] INFO: Found listing with ID: UD99211
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD99211%27 HTTP/1.1" 200 None
2026-03-30 09:10:31 [auto1.it] INFO: Scrape type for UD99211: 2
2026-03-30 09:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2239071-2862-5308-b0b3-5e4ce38dcaa3 with identifier: UD99211
2026-03-30 09:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2239071-2862-5308-b0b3-5e4ce38dcaa3 with scrape type 2
2026-03-30 09:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2239071-2862-5308-b0b3-5e4ce38dcaa3 with scrape type 2
2026-03-30 09:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b2239071-2862-5308-b0b3-5e4ce38dcaa3, identifier: UD99211
2026-03-30 09:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b2239071-2862-5308-b0b3-5e4ce38dcaa3 with identifier: UD99211
2026-03-30 09:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b2239071-2862-5308-b0b3-5e4ce38dcaa3 with identifier: UD99211
2026-03-30 09:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b2239071-2862-5308-b0b3-5e4ce38dcaa3 with identifier: UD99211 to the API
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:43Z',
 'fuel_type': 'diesel',
 'id': 'b2239071-2862-5308-b0b3-5e4ce38dcaa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD99211',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 164500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-03',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 dCi N-Tec 4x4',
 'transmission': 'manual',
 'trim': 'N-Tec 4x4',
 'year': 2011}
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD99211%27 HTTP/1.1" 200 None
2026-03-30 09:10:31 [auto1.it] INFO: Saving data for UD99211: {'auction_closing_time': 1774885363.0, 'created_time': 1774688432.821066, 'last_price_update_time': 1774861831.964904}
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD99211') HTTP/1.1" 204 0
2026-03-30 09:10:31 [auto1.it] INFO: Found listing with ID: SX47374
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX47374%27 HTTP/1.1" 200 None
2026-03-30 09:10:32 [auto1.it] INFO: Scrape type for SX47374: 2
2026-03-30 09:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d with identifier: SX47374
2026-03-30 09:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d with scrape type 2
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d with scrape type 2
2026-03-30 09:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d, identifier: SX47374
2026-03-30 09:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d with identifier: SX47374
2026-03-30 09:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d with identifier: SX47374
2026-03-30 09:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d with identifier: SX47374 to the API
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:06:02Z',
 'fuel_type': 'diesel',
 'id': '8b7e9d92-5c1c-59a6-a4d8-6121cde1c80d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX47374',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 208445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-06',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2018}
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX47374%27 HTTP/1.1" 200 None
2026-03-30 09:10:32 [auto1.it] INFO: Saving data for SX47374: {'auction_closing_time': 1774883162.0, 'created_time': 1774688424.931988, 'last_price_update_time': 1774861832.364325}
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SX47374') HTTP/1.1" 204 0
2026-03-30 09:10:32 [auto1.it] INFO: Found listing with ID: AP90035
2026-03-30 09:10:32 [auto1.it] INFO: Found listing with ID: NS10029
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS10029%27 HTTP/1.1" 200 None
2026-03-30 09:10:32 [auto1.it] INFO: Scrape type for NS10029: 2
2026-03-30 09:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 147f78cc-380a-581c-9a8a-580c07129338 with identifier: NS10029
2026-03-30 09:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 147f78cc-380a-581c-9a8a-580c07129338 with scrape type 2
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 147f78cc-380a-581c-9a8a-580c07129338 with scrape type 2
2026-03-30 09:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 147f78cc-380a-581c-9a8a-580c07129338, identifier: NS10029
2026-03-30 09:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 147f78cc-380a-581c-9a8a-580c07129338 with identifier: NS10029
2026-03-30 09:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 147f78cc-380a-581c-9a8a-580c07129338 with identifier: NS10029
2026-03-30 09:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 147f78cc-380a-581c-9a8a-580c07129338 with identifier: NS10029 to the API
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:47:23Z',
 'fuel_type': 'petrol',
 'id': '147f78cc-380a-581c-9a8a-580c07129338',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS10029',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 120461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-26',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS10029%27 HTTP/1.1" 200 None
2026-03-30 09:10:32 [auto1.it] INFO: Saving data for NS10029: {'auction_closing_time': 1774885643.0, 'created_time': 1774688423.953285, 'last_price_update_time': 1774861832.761465}
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NS10029') HTTP/1.1" 204 0
2026-03-30 09:10:32 [auto1.it] INFO: Found listing with ID: BY89134
2026-03-30 09:10:32 [auto1.it] INFO: Found listing with ID: TW88152
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW88152%27 HTTP/1.1" 200 None
2026-03-30 09:10:32 [auto1.it] INFO: Scrape type for TW88152: 2
2026-03-30 09:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1a92a41-4229-59b0-9860-e8d72eee9698 with identifier: TW88152
2026-03-30 09:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1a92a41-4229-59b0-9860-e8d72eee9698 with scrape type 2
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1a92a41-4229-59b0-9860-e8d72eee9698 with scrape type 2
2026-03-30 09:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f1a92a41-4229-59b0-9860-e8d72eee9698, identifier: TW88152
2026-03-30 09:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f1a92a41-4229-59b0-9860-e8d72eee9698 with identifier: TW88152
2026-03-30 09:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f1a92a41-4229-59b0-9860-e8d72eee9698 with identifier: TW88152
2026-03-30 09:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f1a92a41-4229-59b0-9860-e8d72eee9698 with identifier: TW88152 to the API
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:39:18Z',
 'fuel_type': 'diesel',
 'id': 'f1a92a41-4229-59b0-9860-e8d72eee9698',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW88152',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 192909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-10',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW88152%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [auto1.it] INFO: Saving data for TW88152: {'auction_closing_time': 1774885158.0, 'created_time': 1774688429.864679, 'last_price_update_time': 1774861833.177465}
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TW88152') HTTP/1.1" 204 0
2026-03-30 09:10:33 [auto1.it] INFO: Found listing with ID: MU21056
2026-03-30 09:10:33 [auto1.it] INFO: Found listing with ID: BG29864
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG29864%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [auto1.it] INFO: Scrape type for BG29864: 2
2026-03-30 09:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1363d362-26a5-5b06-9d73-858bc7619dd2 with identifier: BG29864
2026-03-30 09:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1363d362-26a5-5b06-9d73-858bc7619dd2 with scrape type 2
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1363d362-26a5-5b06-9d73-858bc7619dd2 with scrape type 2
2026-03-30 09:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1363d362-26a5-5b06-9d73-858bc7619dd2, identifier: BG29864
2026-03-30 09:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1363d362-26a5-5b06-9d73-858bc7619dd2 with identifier: BG29864
2026-03-30 09:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1363d362-26a5-5b06-9d73-858bc7619dd2 with identifier: BG29864
2026-03-30 09:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1363d362-26a5-5b06-9d73-858bc7619dd2 with identifier: BG29864 to the API
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:17:09Z',
 'fuel_type': 'petrol',
 'id': '1363d362-26a5-5b06-9d73-858bc7619dd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG29864',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 119769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2015}
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG29864%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [auto1.it] INFO: Saving data for BG29864: {'auction_closing_time': 1774883829.0, 'created_time': 1774688431.983523, 'last_price_update_time': 1774861833.66007}
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BG29864') HTTP/1.1" 204 0
2026-03-30 09:10:33 [auto1.it] INFO: Found listing with ID: XE56181
2026-03-30 09:10:33 [auto1.it] INFO: Found listing with ID: WY26414
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY26414%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [auto1.it] INFO: Scrape type for WY26414: 2
2026-03-30 09:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c671b85-f866-5acd-8d39-772f2c4e4d58 with identifier: WY26414
2026-03-30 09:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c671b85-f866-5acd-8d39-772f2c4e4d58 with scrape type 2
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c671b85-f866-5acd-8d39-772f2c4e4d58 with scrape type 2
2026-03-30 09:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c671b85-f866-5acd-8d39-772f2c4e4d58, identifier: WY26414
2026-03-30 09:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c671b85-f866-5acd-8d39-772f2c4e4d58 with identifier: WY26414
2026-03-30 09:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c671b85-f866-5acd-8d39-772f2c4e4d58 with identifier: WY26414
2026-03-30 09:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c671b85-f866-5acd-8d39-772f2c4e4d58 with identifier: WY26414 to the API
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:47Z',
 'fuel_type': 'petrol',
 'id': '4c671b85-f866-5acd-8d39-772f2c4e4d58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY26414',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 20350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-30',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid XLine 2WD',
 'transmission': 'automatic',
 'trim': 'XLine 2WD',
 'year': 2023}
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY26414%27 HTTP/1.1" 200 None
2026-03-30 09:10:34 [auto1.it] INFO: Saving data for WY26414: {'auction_closing_time': 1774883147.0, 'created_time': 1774688459.852184, 'last_price_update_time': 1774861834.116811}
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WY26414') HTTP/1.1" 204 0
2026-03-30 09:10:34 [auto1.it] INFO: Found listing with ID: CP34925
2026-03-30 09:10:34 [auto1.it] INFO: Found listing with ID: UB84582
2026-03-30 09:10:34 [auto1.it] INFO: Found listing with ID: HY41860
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY41860%27 HTTP/1.1" 200 None
2026-03-30 09:10:34 [auto1.it] INFO: Scrape type for HY41860: 2
2026-03-30 09:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f2c3dce-5942-5608-8b87-e8147630bbdb with identifier: HY41860
2026-03-30 09:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f2c3dce-5942-5608-8b87-e8147630bbdb with scrape type 2
2026-03-30 09:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f2c3dce-5942-5608-8b87-e8147630bbdb with scrape type 2
2026-03-30 09:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f2c3dce-5942-5608-8b87-e8147630bbdb, identifier: HY41860
2026-03-30 09:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f2c3dce-5942-5608-8b87-e8147630bbdb with identifier: HY41860
2026-03-30 09:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f2c3dce-5942-5608-8b87-e8147630bbdb with identifier: HY41860
2026-03-30 09:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f2c3dce-5942-5608-8b87-e8147630bbdb with identifier: HY41860 to the API
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:06:42Z',
 'fuel_type': 'gas',
 'id': '9f2c3dce-5942-5608-8b87-e8147630bbdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY41860',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 200947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-30',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic GPL',
 'transmission': 'manual',
 'trim': 'Dynamic GPL',
 'year': 2009}
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY41860%27 HTTP/1.1" 200 None
2026-03-30 09:10:34 [auto1.it] INFO: Saving data for HY41860: {'auction_closing_time': 1774883202.0, 'created_time': 1774688458.392944, 'last_price_update_time': 1774861834.503551}
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY41860') HTTP/1.1" 204 0
2026-03-30 09:10:34 [auto1.it] INFO: Found listing with ID: CB28979
2026-03-30 09:10:34 [auto1.it] INFO: Found listing with ID: FD69176
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD69176%27 HTTP/1.1" 200 None
2026-03-30 09:10:34 [auto1.it] INFO: Scrape type for FD69176: 2
2026-03-30 09:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 272a2abb-ea00-5227-86d6-27f128f3fc71 with identifier: FD69176
2026-03-30 09:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 272a2abb-ea00-5227-86d6-27f128f3fc71 with scrape type 2
2026-03-30 09:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 272a2abb-ea00-5227-86d6-27f128f3fc71 with scrape type 2
2026-03-30 09:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 272a2abb-ea00-5227-86d6-27f128f3fc71, identifier: FD69176
2026-03-30 09:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 272a2abb-ea00-5227-86d6-27f128f3fc71 with identifier: FD69176
2026-03-30 09:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 272a2abb-ea00-5227-86d6-27f128f3fc71 with identifier: FD69176
2026-03-30 09:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 272a2abb-ea00-5227-86d6-27f128f3fc71 with identifier: FD69176 to the API
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:09Z',
 'fuel_type': 'diesel',
 'id': '272a2abb-ea00-5227-86d6-27f128f3fc71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD69176',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 37673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-20',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD69176%27 HTTP/1.1" 200 None
2026-03-30 09:10:34 [auto1.it] INFO: Saving data for FD69176: {'auction_closing_time': 1774884009.0, 'created_time': 1774688461.034196, 'last_price_update_time': 1774861834.908511}
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FD69176') HTTP/1.1" 204 0
2026-03-30 09:10:34 [auto1.it] INFO: Found listing with ID: RG05236
2026-03-30 09:10:34 [auto1.it] INFO: Found listing with ID: MN63848
2026-03-30 09:10:34 [auto1.it] INFO: Found listing with ID: GC15950
2026-03-30 09:10:34 [auto1.it] INFO: Found listing with ID: ZU87038
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU87038%27 HTTP/1.1" 200 None
2026-03-30 09:10:34 [auto1.it] INFO: Scrape type for ZU87038: 2
2026-03-30 09:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1828b9e-02e9-519e-b209-ff64bf547566 with identifier: ZU87038
2026-03-30 09:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1828b9e-02e9-519e-b209-ff64bf547566 with scrape type 2
2026-03-30 09:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1828b9e-02e9-519e-b209-ff64bf547566 with scrape type 2
2026-03-30 09:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1828b9e-02e9-519e-b209-ff64bf547566, identifier: ZU87038
2026-03-30 09:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1828b9e-02e9-519e-b209-ff64bf547566 with identifier: ZU87038
2026-03-30 09:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1828b9e-02e9-519e-b209-ff64bf547566 with identifier: ZU87038
2026-03-30 09:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a1828b9e-02e9-519e-b209-ff64bf547566 with identifier: ZU87038 to the API
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:24:56Z',
 'fuel_type': 'petrol',
 'id': 'a1828b9e-02e9-519e-b209-ff64bf547566',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU87038',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 127648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-30',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2009}
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU87038%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [auto1.it] INFO: Saving data for ZU87038: {'auction_closing_time': 1774884296.0, 'created_time': 1774688462.339503, 'last_price_update_time': 1774861835.344694}
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU87038') HTTP/1.1" 204 0
2026-03-30 09:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:35 [auto1.it] INFO: Found listing with ID: YR71782
2026-03-30 09:10:35 [auto1.it] INFO: Found listing with ID: RX70685
2026-03-30 09:10:35 [auto1.it] INFO: Found listing with ID: ZG33148
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG33148%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [auto1.it] INFO: Scrape type for ZG33148: 2
2026-03-30 09:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f06a38f-00e0-537d-8b5c-91f81f010173 with identifier: ZG33148
2026-03-30 09:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f06a38f-00e0-537d-8b5c-91f81f010173 with scrape type 2
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f06a38f-00e0-537d-8b5c-91f81f010173 with scrape type 2
2026-03-30 09:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f06a38f-00e0-537d-8b5c-91f81f010173, identifier: ZG33148
2026-03-30 09:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f06a38f-00e0-537d-8b5c-91f81f010173 with identifier: ZG33148
2026-03-30 09:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f06a38f-00e0-537d-8b5c-91f81f010173 with identifier: ZG33148
2026-03-30 09:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f06a38f-00e0-537d-8b5c-91f81f010173 with identifier: ZG33148 to the API
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:44:50Z',
 'fuel_type': 'petrol',
 'id': '9f06a38f-00e0-537d-8b5c-91f81f010173',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG33148',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 113114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive pulse',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive pulse',
 'year': 2013}
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG33148%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [auto1.it] INFO: Saving data for ZG33148: {'auction_closing_time': 1774885490.0, 'created_time': 1774688442.613058, 'last_price_update_time': 1774861835.925423}
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZG33148') HTTP/1.1" 204 0
2026-03-30 09:10:35 [auto1.it] INFO: Found listing with ID: JP42061
2026-03-30 09:10:35 [auto1.it] INFO: Found listing with ID: PR59695
2026-03-30 09:10:35 [auto1.it] INFO: Found listing with ID: YC40082
2026-03-30 09:10:35 [auto1.it] INFO: Found listing with ID: AL09653
2026-03-30 09:10:35 [auto1.it] INFO: Found listing with ID: DK55043
2026-03-30 09:10:35 [auto1.it] INFO: Found listing with ID: AG82147
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG82147%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [auto1.it] INFO: Scrape type for AG82147: 2
2026-03-30 09:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df2e52db-61dc-5a76-9435-08d746d02bef with identifier: AG82147
2026-03-30 09:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df2e52db-61dc-5a76-9435-08d746d02bef with scrape type 2
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df2e52db-61dc-5a76-9435-08d746d02bef with scrape type 2
2026-03-30 09:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: df2e52db-61dc-5a76-9435-08d746d02bef, identifier: AG82147
2026-03-30 09:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: df2e52db-61dc-5a76-9435-08d746d02bef with identifier: AG82147
2026-03-30 09:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: df2e52db-61dc-5a76-9435-08d746d02bef with identifier: AG82147
2026-03-30 09:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: df2e52db-61dc-5a76-9435-08d746d02bef with identifier: AG82147 to the API
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:26:54Z',
 'fuel_type': 'diesel',
 'id': 'df2e52db-61dc-5a76-9435-08d746d02bef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG82147',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 297907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-31',
 'seller_name': None,
 'title': 'Fiat 500L 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG82147%27 HTTP/1.1" 200 None
2026-03-30 09:10:36 [auto1.it] INFO: Saving data for AG82147: {'auction_closing_time': 1774884414.0, 'created_time': 1774688455.139783, 'last_price_update_time': 1774861836.329422}
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AG82147') HTTP/1.1" 204 0
2026-03-30 09:10:36 [auto1.it] INFO: Channel: 24h | Page: 82 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:36 [auto1.it] INFO: Found listing with ID: RG79014
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG79014%27 HTTP/1.1" 200 None
2026-03-30 09:10:36 [auto1.it] INFO: Scrape type for RG79014: 2
2026-03-30 09:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bdd4a83-a025-5966-8982-3aa39ebc9962 with identifier: RG79014
2026-03-30 09:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bdd4a83-a025-5966-8982-3aa39ebc9962 with scrape type 2
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bdd4a83-a025-5966-8982-3aa39ebc9962 with scrape type 2
2026-03-30 09:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4bdd4a83-a025-5966-8982-3aa39ebc9962, identifier: RG79014
2026-03-30 09:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4bdd4a83-a025-5966-8982-3aa39ebc9962 with identifier: RG79014
2026-03-30 09:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4bdd4a83-a025-5966-8982-3aa39ebc9962 with identifier: RG79014
2026-03-30 09:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4bdd4a83-a025-5966-8982-3aa39ebc9962 with identifier: RG79014 to the API
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-30T15:33:07Z',
 'fuel_type': 'diesel',
 'id': '4bdd4a83-a025-5966-8982-3aa39ebc9962',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG79014',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 149001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-05',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2022}
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG79014%27 HTTP/1.1" 200 None
2026-03-30 09:10:36 [auto1.it] INFO: Saving data for RG79014: {'auction_closing_time': 1774884787.0, 'created_time': 1774688474.594693, 'last_price_update_time': 1774861836.718641}
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG79014') HTTP/1.1" 204 0
2026-03-30 09:10:36 [auto1.it] INFO: Found listing with ID: NU26591
2026-03-30 09:10:36 [auto1.it] INFO: Found listing with ID: UB42424
2026-03-30 09:10:36 [auto1.it] INFO: Found listing with ID: RV63380
2026-03-30 09:10:36 [auto1.it] INFO: Found listing with ID: JE70672
2026-03-30 09:10:36 [auto1.it] INFO: Found listing with ID: KL44785
2026-03-30 09:10:36 [auto1.it] INFO: Found listing with ID: TU59167
2026-03-30 09:10:36 [auto1.it] INFO: Found listing with ID: TD04886
2026-03-30 09:10:36 [auto1.it] INFO: Found listing with ID: NK26905
2026-03-30 09:10:36 [auto1.it] INFO: Found listing with ID: PL47981
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL47981%27 HTTP/1.1" 200 None
2026-03-30 09:10:36 [auto1.it] INFO: Scrape type for PL47981: 2
2026-03-30 09:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b10f1009-142e-5ef2-a38b-d15c49bfd732 with identifier: PL47981
2026-03-30 09:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b10f1009-142e-5ef2-a38b-d15c49bfd732 with scrape type 2
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b10f1009-142e-5ef2-a38b-d15c49bfd732 with scrape type 2
2026-03-30 09:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b10f1009-142e-5ef2-a38b-d15c49bfd732, identifier: PL47981
2026-03-30 09:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b10f1009-142e-5ef2-a38b-d15c49bfd732 with identifier: PL47981
2026-03-30 09:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b10f1009-142e-5ef2-a38b-d15c49bfd732 with identifier: PL47981
2026-03-30 09:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b10f1009-142e-5ef2-a38b-d15c49bfd732 with identifier: PL47981 to the API
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:04:32Z',
 'fuel_type': 'diesel',
 'id': 'b10f1009-142e-5ef2-a38b-d15c49bfd732',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL47981',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 331683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-20',
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2003}
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL47981%27 HTTP/1.1" 200 None
2026-03-30 09:10:37 [auto1.it] INFO: Saving data for PL47981: {'auction_closing_time': 1774883072.0, 'created_time': 1774688441.927889, 'last_price_update_time': 1774861837.162515}
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PL47981') HTTP/1.1" 204 0
2026-03-30 09:10:37 [auto1.it] INFO: Found listing with ID: EP64063
2026-03-30 09:10:37 [auto1.it] INFO: Found listing with ID: XS31843
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS31843%27 HTTP/1.1" 200 None
2026-03-30 09:10:37 [auto1.it] INFO: Scrape type for XS31843: 2
2026-03-30 09:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cdad10a-9437-57dc-86ac-53301d8e35e8 with identifier: XS31843
2026-03-30 09:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cdad10a-9437-57dc-86ac-53301d8e35e8 with scrape type 2
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cdad10a-9437-57dc-86ac-53301d8e35e8 with scrape type 2
2026-03-30 09:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6cdad10a-9437-57dc-86ac-53301d8e35e8, identifier: XS31843
2026-03-30 09:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6cdad10a-9437-57dc-86ac-53301d8e35e8 with identifier: XS31843
2026-03-30 09:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6cdad10a-9437-57dc-86ac-53301d8e35e8 with identifier: XS31843
2026-03-30 09:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6cdad10a-9437-57dc-86ac-53301d8e35e8 with identifier: XS31843 to the API
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:06:10Z',
 'fuel_type': 'diesel',
 'id': '6cdad10a-9437-57dc-86ac-53301d8e35e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS31843',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 155438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-04',
 'seller_name': None,
 'title': 'Audi Q5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS31843%27 HTTP/1.1" 200 None
2026-03-30 09:10:37 [auto1.it] INFO: Saving data for XS31843: {'auction_closing_time': 1774883170.0, 'created_time': 1774688463.342992, 'last_price_update_time': 1774861837.684708}
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XS31843') HTTP/1.1" 204 0
2026-03-30 09:10:37 [auto1.it] INFO: Found listing with ID: DP98022
2026-03-30 09:10:37 [auto1.it] INFO: Found listing with ID: TZ57511
2026-03-30 09:10:37 [auto1.it] INFO: Found listing with ID: XF75286
2026-03-30 09:10:37 [auto1.it] INFO: Found listing with ID: MN96094
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN96094%27 HTTP/1.1" 200 None
2026-03-30 09:10:37 [auto1.it] INFO: Scrape type for MN96094: 2
2026-03-30 09:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f4453a-fce6-56ce-a906-1d6d34763870 with identifier: MN96094
2026-03-30 09:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f4453a-fce6-56ce-a906-1d6d34763870 with scrape type 2
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17f4453a-fce6-56ce-a906-1d6d34763870 with scrape type 2
2026-03-30 09:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 17f4453a-fce6-56ce-a906-1d6d34763870, identifier: MN96094
2026-03-30 09:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 17f4453a-fce6-56ce-a906-1d6d34763870 with identifier: MN96094
2026-03-30 09:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 17f4453a-fce6-56ce-a906-1d6d34763870 with identifier: MN96094
2026-03-30 09:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 17f4453a-fce6-56ce-a906-1d6d34763870 with identifier: MN96094 to the API
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:53:26Z',
 'fuel_type': 'petrol',
 'id': '17f4453a-fce6-56ce-a906-1d6d34763870',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN96094',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 93974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-04',
 'seller_name': None,
 'title': 'Skoda Roomster 1.2 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2007}
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN96094%27 HTTP/1.1" 200 None
2026-03-30 09:10:38 [auto1.it] INFO: Saving data for MN96094: {'auction_closing_time': 1774886006.0, 'created_time': 1774342924.722371, 'last_price_update_time': 1774861838.119079}
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MN96094') HTTP/1.1" 204 0
2026-03-30 09:10:38 [auto1.it] INFO: Found listing with ID: YD21144
2026-03-30 09:10:38 [auto1.it] INFO: Found listing with ID: RT57270
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT57270%27 HTTP/1.1" 200 None
2026-03-30 09:10:38 [auto1.it] INFO: Scrape type for RT57270: 2
2026-03-30 09:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff6890d4-a840-546e-a6b8-95d4b516185a with identifier: RT57270
2026-03-30 09:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff6890d4-a840-546e-a6b8-95d4b516185a with scrape type 2
2026-03-30 09:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff6890d4-a840-546e-a6b8-95d4b516185a with scrape type 2
2026-03-30 09:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff6890d4-a840-546e-a6b8-95d4b516185a, identifier: RT57270
2026-03-30 09:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff6890d4-a840-546e-a6b8-95d4b516185a with identifier: RT57270
2026-03-30 09:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff6890d4-a840-546e-a6b8-95d4b516185a with identifier: RT57270
2026-03-30 09:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff6890d4-a840-546e-a6b8-95d4b516185a with identifier: RT57270 to the API
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:16:23Z',
 'fuel_type': 'diesel',
 'id': 'ff6890d4-a840-546e-a6b8-95d4b516185a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT57270',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 174503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-08',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTDM Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2015}
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT57270%27 HTTP/1.1" 200 None
2026-03-30 09:10:38 [auto1.it] INFO: Saving data for RT57270: {'auction_closing_time': 1774883783.0, 'created_time': 1774688479.230442, 'last_price_update_time': 1774861838.762266}
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT57270') HTTP/1.1" 204 0
2026-03-30 09:10:38 [auto1.it] INFO: Found listing with ID: JC99655
2026-03-30 09:10:38 [auto1.it] INFO: Found listing with ID: YN59096
2026-03-30 09:10:38 [auto1.it] INFO: Found listing with ID: PC10641
2026-03-30 09:10:38 [auto1.it] INFO: Found listing with ID: MH04778
2026-03-30 09:10:38 [auto1.it] INFO: Found listing with ID: HG07035
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG07035%27 HTTP/1.1" 200 None
2026-03-30 09:10:38 [auto1.it] INFO: Scrape type for HG07035: 2
2026-03-30 09:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f063555-c039-5a3b-af5d-128cb95a9954 with identifier: HG07035
2026-03-30 09:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f063555-c039-5a3b-af5d-128cb95a9954 with scrape type 2
2026-03-30 09:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f063555-c039-5a3b-af5d-128cb95a9954 with scrape type 2
2026-03-30 09:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f063555-c039-5a3b-af5d-128cb95a9954, identifier: HG07035
2026-03-30 09:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f063555-c039-5a3b-af5d-128cb95a9954 with identifier: HG07035
2026-03-30 09:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f063555-c039-5a3b-af5d-128cb95a9954 with identifier: HG07035
2026-03-30 09:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f063555-c039-5a3b-af5d-128cb95a9954 with identifier: HG07035 to the API
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:00:45Z',
 'fuel_type': 'petrol',
 'id': '8f063555-c039-5a3b-af5d-128cb95a9954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG07035',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 115403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-20',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2008}
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG07035%27 HTTP/1.1" 200 None
2026-03-30 09:10:39 [auto1.it] INFO: Saving data for HG07035: {'auction_closing_time': 1774882845.0, 'created_time': 1774688445.270092, 'last_price_update_time': 1774861839.156403}
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HG07035') HTTP/1.1" 204 0
2026-03-30 09:10:39 [auto1.it] INFO: Found listing with ID: RB57838
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB57838%27 HTTP/1.1" 200 None
2026-03-30 09:10:39 [auto1.it] INFO: Scrape type for RB57838: 2
2026-03-30 09:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc8b1de5-1d46-54ca-9908-fc5b5d698057 with identifier: RB57838
2026-03-30 09:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc8b1de5-1d46-54ca-9908-fc5b5d698057 with scrape type 2
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc8b1de5-1d46-54ca-9908-fc5b5d698057 with scrape type 2
2026-03-30 09:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fc8b1de5-1d46-54ca-9908-fc5b5d698057, identifier: RB57838
2026-03-30 09:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fc8b1de5-1d46-54ca-9908-fc5b5d698057 with identifier: RB57838
2026-03-30 09:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fc8b1de5-1d46-54ca-9908-fc5b5d698057 with identifier: RB57838
2026-03-30 09:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fc8b1de5-1d46-54ca-9908-fc5b5d698057 with identifier: RB57838 to the API
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:46:17Z',
 'fuel_type': 'petrol',
 'id': 'fc8b1de5-1d46-54ca-9908-fc5b5d698057',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB57838',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 170486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-01',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2017}
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB57838%27 HTTP/1.1" 200 None
2026-03-30 09:10:39 [auto1.it] INFO: Saving data for RB57838: {'auction_closing_time': 1774885577.0, 'created_time': 1774688463.686792, 'last_price_update_time': 1774861839.855271}
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RB57838') HTTP/1.1" 204 0
2026-03-30 09:10:39 [auto1.it] INFO: Found listing with ID: UW00940
2026-03-30 09:10:39 [auto1.it] INFO: Found listing with ID: PD21393
2026-03-30 09:10:39 [auto1.it] INFO: Found listing with ID: CR16346
2026-03-30 09:10:39 [auto1.it] INFO: Found listing with ID: AU50392
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU50392%27 HTTP/1.1" 200 None
2026-03-30 09:10:39 [auto1.it] INFO: Scrape type for AU50392: 2
2026-03-30 09:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf6de24c-2fce-5019-a0eb-41c0cf48ef9e with identifier: AU50392
2026-03-30 09:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e with scrape type 2
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf6de24c-2fce-5019-a0eb-41c0cf48ef9e with scrape type 2
2026-03-30 09:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf6de24c-2fce-5019-a0eb-41c0cf48ef9e, identifier: AU50392
2026-03-30 09:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf6de24c-2fce-5019-a0eb-41c0cf48ef9e with identifier: AU50392
2026-03-30 09:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf6de24c-2fce-5019-a0eb-41c0cf48ef9e with identifier: AU50392
2026-03-30 09:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf6de24c-2fce-5019-a0eb-41c0cf48ef9e with identifier: AU50392 to the API
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:32:48Z',
 'fuel_type': 'petrol',
 'id': 'bf6de24c-2fce-5019-a0eb-41c0cf48ef9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU50392',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 104403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-30',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 GL Style',
 'transmission': 'manual',
 'trim': 'GL Style',
 'year': 2013}
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU50392%27 HTTP/1.1" 200 None
2026-03-30 09:10:40 [auto1.it] INFO: Saving data for AU50392: {'auction_closing_time': 1774884768.0, 'created_time': 1774688469.324207, 'last_price_update_time': 1774861840.271712}
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AU50392') HTTP/1.1" 204 0
2026-03-30 09:10:40 [auto1.it] INFO: Found listing with ID: XK62729
2026-03-30 09:10:40 [auto1.it] INFO: Found listing with ID: BD17279
2026-03-30 09:10:40 [auto1.it] INFO: Found listing with ID: VV69855
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV69855%27 HTTP/1.1" 200 None
2026-03-30 09:10:40 [auto1.it] INFO: Scrape type for VV69855: 2
2026-03-30 09:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 736efd31-a741-58bc-ba47-075110b051d8 with identifier: VV69855
2026-03-30 09:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 736efd31-a741-58bc-ba47-075110b051d8 with scrape type 2
2026-03-30 09:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 736efd31-a741-58bc-ba47-075110b051d8 with scrape type 2
2026-03-30 09:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 736efd31-a741-58bc-ba47-075110b051d8, identifier: VV69855
2026-03-30 09:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 736efd31-a741-58bc-ba47-075110b051d8 with identifier: VV69855
2026-03-30 09:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 736efd31-a741-58bc-ba47-075110b051d8 with identifier: VV69855
2026-03-30 09:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 736efd31-a741-58bc-ba47-075110b051d8 with identifier: VV69855 to the API
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:41:56Z',
 'fuel_type': 'petrol',
 'id': '736efd31-a741-58bc-ba47-075110b051d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV69855',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 188559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-27',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 Sport FWD',
 'transmission': 'manual',
 'trim': 'Sport FWD',
 'year': 2016}
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV69855%27 HTTP/1.1" 200 None
2026-03-30 09:10:40 [auto1.it] INFO: Saving data for VV69855: {'auction_closing_time': 1774885316.0, 'created_time': 1774688457.501142, 'last_price_update_time': 1774861840.657062}
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VV69855') HTTP/1.1" 204 0
2026-03-30 09:10:40 [auto1.it] INFO: Found listing with ID: WP22813
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP22813%27 HTTP/1.1" 200 None
2026-03-30 09:10:40 [auto1.it] INFO: Scrape type for WP22813: 2
2026-03-30 09:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73204430-20b8-5743-81ef-4bebb2f6f628 with identifier: WP22813
2026-03-30 09:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73204430-20b8-5743-81ef-4bebb2f6f628 with scrape type 2
2026-03-30 09:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73204430-20b8-5743-81ef-4bebb2f6f628 with scrape type 2
2026-03-30 09:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 73204430-20b8-5743-81ef-4bebb2f6f628, identifier: WP22813
2026-03-30 09:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 73204430-20b8-5743-81ef-4bebb2f6f628 with identifier: WP22813
2026-03-30 09:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 73204430-20b8-5743-81ef-4bebb2f6f628 with identifier: WP22813
2026-03-30 09:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 73204430-20b8-5743-81ef-4bebb2f6f628 with identifier: WP22813 to the API
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:47:09Z',
 'fuel_type': 'hybrid',
 'id': '73204430-20b8-5743-81ef-4bebb2f6f628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP22813',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 93918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2018}
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP22813%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [auto1.it] INFO: Saving data for WP22813: {'auction_closing_time': 1774885629.0, 'created_time': 1774688444.40334, 'last_price_update_time': 1774861841.114789}
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WP22813') HTTP/1.1" 204 0
2026-03-30 09:10:41 [auto1.it] INFO: Found listing with ID: PZ74443
2026-03-30 09:10:41 [auto1.it] INFO: Found listing with ID: DF91853
2026-03-30 09:10:41 [auto1.it] INFO: Found listing with ID: NA17081
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA17081%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [auto1.it] INFO: Scrape type for NA17081: 2
2026-03-30 09:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a6cd56f-c27f-56ed-ac38-0429846fcb07 with identifier: NA17081
2026-03-30 09:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a6cd56f-c27f-56ed-ac38-0429846fcb07 with scrape type 2
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a6cd56f-c27f-56ed-ac38-0429846fcb07 with scrape type 2
2026-03-30 09:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a6cd56f-c27f-56ed-ac38-0429846fcb07, identifier: NA17081
2026-03-30 09:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a6cd56f-c27f-56ed-ac38-0429846fcb07 with identifier: NA17081
2026-03-30 09:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a6cd56f-c27f-56ed-ac38-0429846fcb07 with identifier: NA17081
2026-03-30 09:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a6cd56f-c27f-56ed-ac38-0429846fcb07 with identifier: NA17081 to the API
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:24:06Z',
 'fuel_type': 'diesel',
 'id': '7a6cd56f-c27f-56ed-ac38-0429846fcb07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA17081',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 235670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 1.6 D2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2014}
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA17081%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [auto1.it] INFO: Saving data for NA17081: {'auction_closing_time': 1774884246.0, 'created_time': 1773954602.019342, 'last_price_update_time': 1774861841.644479}
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NA17081') HTTP/1.1" 204 0
2026-03-30 09:10:41 [auto1.it] INFO: Found listing with ID: KA05234
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA05234%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [auto1.it] INFO: Scrape type for KA05234: 2
2026-03-30 09:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ed38df8-2ef2-584e-bfcc-cb149feefcfc with identifier: KA05234
2026-03-30 09:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc with scrape type 2
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ed38df8-2ef2-584e-bfcc-cb149feefcfc with scrape type 2
2026-03-30 09:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1ed38df8-2ef2-584e-bfcc-cb149feefcfc, identifier: KA05234
2026-03-30 09:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1ed38df8-2ef2-584e-bfcc-cb149feefcfc with identifier: KA05234
2026-03-30 09:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1ed38df8-2ef2-584e-bfcc-cb149feefcfc with identifier: KA05234
2026-03-30 09:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1ed38df8-2ef2-584e-bfcc-cb149feefcfc with identifier: KA05234 to the API
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:30:23Z',
 'fuel_type': 'diesel',
 'id': '1ed38df8-2ef2-584e-bfcc-cb149feefcfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA05234',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 89289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 M-Jet Limited 4x4',
 'transmission': 'automatic',
 'trim': 'Limited 4x4',
 'year': 2019}
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA05234%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [auto1.it] INFO: Saving data for KA05234: {'auction_closing_time': 1774884623.0, 'created_time': 1774688460.319661, 'last_price_update_time': 1774861842.25489}
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KA05234') HTTP/1.1" 204 0
2026-03-30 09:10:42 [auto1.it] INFO: Found listing with ID: XL36522
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL36522%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [auto1.it] INFO: Scrape type for XL36522: 2
2026-03-30 09:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58e2a63a-002e-5c18-9686-90d7731f8a23 with identifier: XL36522
2026-03-30 09:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58e2a63a-002e-5c18-9686-90d7731f8a23 with scrape type 2
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58e2a63a-002e-5c18-9686-90d7731f8a23 with scrape type 2
2026-03-30 09:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 58e2a63a-002e-5c18-9686-90d7731f8a23, identifier: XL36522
2026-03-30 09:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 58e2a63a-002e-5c18-9686-90d7731f8a23 with identifier: XL36522
2026-03-30 09:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 58e2a63a-002e-5c18-9686-90d7731f8a23 with identifier: XL36522
2026-03-30 09:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 58e2a63a-002e-5c18-9686-90d7731f8a23 with identifier: XL36522 to the API
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:20:59Z',
 'fuel_type': 'diesel',
 'id': '58e2a63a-002e-5c18-9686-90d7731f8a23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL36522',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 192092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-07',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi SW Cool",
 'transmission': 'automatic',
 'trim': 'SW Cool',
 'year': 2013}
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL36522%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [auto1.it] INFO: Saving data for XL36522: {'auction_closing_time': 1774884059.0, 'created_time': 1774688478.521589, 'last_price_update_time': 1774861842.856124}
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XL36522') HTTP/1.1" 204 0
2026-03-30 09:10:42 [auto1.it] INFO: Found listing with ID: WJ93918
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ93918%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [auto1.it] INFO: Scrape type for WJ93918: 2
2026-03-30 09:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d with identifier: WJ93918
2026-03-30 09:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d with scrape type 2
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d with scrape type 2
2026-03-30 09:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d, identifier: WJ93918
2026-03-30 09:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d with identifier: WJ93918
2026-03-30 09:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d with identifier: WJ93918
2026-03-30 09:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3adcadb9-bc54-53b7-8c2d-ef2a711bb45d with identifier: WJ93918 to the API
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:42Z',
 'fuel_type': 'petrol',
 'id': '3adcadb9-bc54-53b7-8c2d-ef2a711bb45d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ93918',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 150720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-03',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2016}
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ93918%27 HTTP/1.1" 200 None
2026-03-30 09:10:43 [auto1.it] INFO: Saving data for WJ93918: {'auction_closing_time': 1774884882.0, 'created_time': 1774688475.528678, 'last_price_update_time': 1774861843.275087}
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WJ93918') HTTP/1.1" 204 0
2026-03-30 09:10:43 [auto1.it] INFO: Channel: 24h | Page: 83 | totalHits: 3310 | hits on page: 30
2026-03-30 09:10:43 [auto1.it] INFO: Found listing with ID: PW21371
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW21371%27 HTTP/1.1" 200 None
2026-03-30 09:10:43 [auto1.it] INFO: Scrape type for PW21371: 2
2026-03-30 09:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5f1250b-caa5-5943-96fb-2c6468c38ac1 with identifier: PW21371
2026-03-30 09:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5f1250b-caa5-5943-96fb-2c6468c38ac1 with scrape type 2
2026-03-30 09:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5f1250b-caa5-5943-96fb-2c6468c38ac1 with scrape type 2
2026-03-30 09:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b5f1250b-caa5-5943-96fb-2c6468c38ac1, identifier: PW21371
2026-03-30 09:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b5f1250b-caa5-5943-96fb-2c6468c38ac1 with identifier: PW21371
2026-03-30 09:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b5f1250b-caa5-5943-96fb-2c6468c38ac1 with identifier: PW21371
2026-03-30 09:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b5f1250b-caa5-5943-96fb-2c6468c38ac1 with identifier: PW21371 to the API
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:09:08Z',
 'fuel_type': 'diesel',
 'id': 'b5f1250b-caa5-5943-96fb-2c6468c38ac1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW21371',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 208990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-27',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW21371%27 HTTP/1.1" 200 None
2026-03-30 09:10:43 [auto1.it] INFO: Saving data for PW21371: {'auction_closing_time': 1774883348.0, 'created_time': 1774688470.999209, 'last_price_update_time': 1774861843.740164}
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW21371') HTTP/1.1" 204 0
2026-03-30 09:10:43 [auto1.it] INFO: Found listing with ID: TL02972
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL02972%27 HTTP/1.1" 200 None
2026-03-30 09:10:43 [auto1.it] INFO: Scrape type for TL02972: 2
2026-03-30 09:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0c048e4-6380-5703-af26-42214e4f4c77 with identifier: TL02972
2026-03-30 09:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0c048e4-6380-5703-af26-42214e4f4c77 with scrape type 2
2026-03-30 09:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0c048e4-6380-5703-af26-42214e4f4c77 with scrape type 2
2026-03-30 09:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f0c048e4-6380-5703-af26-42214e4f4c77, identifier: TL02972
2026-03-30 09:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:43 [auto1.it] INFO: Found listing with ID: TR54078
2026-03-30 09:10:43 [auto1.it] INFO: Found listing with ID: LG70821
2026-03-30 09:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f0c048e4-6380-5703-af26-42214e4f4c77 with identifier: TL02972
2026-03-30 09:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f0c048e4-6380-5703-af26-42214e4f4c77 with identifier: TL02972
2026-03-30 09:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f0c048e4-6380-5703-af26-42214e4f4c77 with identifier: TL02972 to the API
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:39:56Z',
 'fuel_type': 'diesel',
 'id': 'f0c048e4-6380-5703-af26-42214e4f4c77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL02972',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 204129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2017}
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL02972%27 HTTP/1.1" 200 None
2026-03-30 09:10:44 [auto1.it] INFO: Saving data for TL02972: {'auction_closing_time': 1774885196.0, 'created_time': 1774688470.530275, 'last_price_update_time': 1774861844.241804}
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TL02972') HTTP/1.1" 204 0
2026-03-30 09:10:44 [auto1.it] INFO: Found listing with ID: PD30072
2026-03-30 09:10:44 [auto1.it] INFO: Found listing with ID: PN93360
2026-03-30 09:10:44 [auto1.it] INFO: Found listing with ID: WH30921
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH30921%27 HTTP/1.1" 200 None
2026-03-30 09:10:44 [auto1.it] INFO: Scrape type for WH30921: 2
2026-03-30 09:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 186bb506-7a70-5713-b211-f145610d42d4 with identifier: WH30921
2026-03-30 09:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 186bb506-7a70-5713-b211-f145610d42d4 with scrape type 2
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 186bb506-7a70-5713-b211-f145610d42d4 with scrape type 2
2026-03-30 09:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 186bb506-7a70-5713-b211-f145610d42d4, identifier: WH30921
2026-03-30 09:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 186bb506-7a70-5713-b211-f145610d42d4 with identifier: WH30921
2026-03-30 09:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 186bb506-7a70-5713-b211-f145610d42d4 with identifier: WH30921
2026-03-30 09:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 186bb506-7a70-5713-b211-f145610d42d4 with identifier: WH30921 to the API
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:40:45Z',
 'fuel_type': 'gas',
 'id': '186bb506-7a70-5713-b211-f145610d42d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH30921',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 108337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 LPG 120 Jahre',
 'transmission': 'manual',
 'trim': '120 Jahre',
 'year': 2019}
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH30921%27 HTTP/1.1" 200 None
2026-03-30 09:10:44 [auto1.it] INFO: Saving data for WH30921: {'auction_closing_time': 1774885245.0, 'created_time': 1774688467.836223, 'last_price_update_time': 1774861844.677768}
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WH30921') HTTP/1.1" 204 0
2026-03-30 09:10:44 [auto1.it] INFO: Found listing with ID: WC55302
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC55302%27 HTTP/1.1" 200 None
2026-03-30 09:10:44 [auto1.it] INFO: Scrape type for WC55302: 0
2026-03-30 09:10:44 [auto1.it] INFO: Found listing with ID: GP46420
2026-03-30 09:10:44 [auto1.it] INFO: Found listing with ID: LD02725
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD02725%27 HTTP/1.1" 200 None
2026-03-30 09:10:44 [auto1.it] INFO: Scrape type for LD02725: 2
2026-03-30 09:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3bca683-eb7a-598b-a351-d4dfa7e848d6 with identifier: LD02725
2026-03-30 09:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3bca683-eb7a-598b-a351-d4dfa7e848d6 with scrape type 2
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3bca683-eb7a-598b-a351-d4dfa7e848d6 with scrape type 2
2026-03-30 09:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3bca683-eb7a-598b-a351-d4dfa7e848d6, identifier: LD02725
2026-03-30 09:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3bca683-eb7a-598b-a351-d4dfa7e848d6 with identifier: LD02725
2026-03-30 09:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3bca683-eb7a-598b-a351-d4dfa7e848d6 with identifier: LD02725
2026-03-30 09:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3bca683-eb7a-598b-a351-d4dfa7e848d6 with identifier: LD02725 to the API
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:53:27Z',
 'fuel_type': 'diesel',
 'id': 'e3bca683-eb7a-598b-a351-d4dfa7e848d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD02725',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 207158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-29',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Business Nav',
 'transmission': 'automatic',
 'trim': 'Business Nav',
 'year': 2013}
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD02725%27 HTTP/1.1" 200 None
2026-03-30 09:10:45 [auto1.it] INFO: Saving data for LD02725: {'auction_closing_time': 1774886007.0, 'created_time': 1774688445.601606, 'last_price_update_time': 1774861845.154316}
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LD02725') HTTP/1.1" 204 0
2026-03-30 09:10:45 [auto1.it] INFO: Found listing with ID: SB80667
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB80667%27 HTTP/1.1" 200 None
2026-03-30 09:10:45 [auto1.it] INFO: Scrape type for SB80667: 2
2026-03-30 09:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88e63003-a893-577a-aebd-a60df651d726 with identifier: SB80667
2026-03-30 09:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e63003-a893-577a-aebd-a60df651d726 with scrape type 2
2026-03-30 09:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88e63003-a893-577a-aebd-a60df651d726 with scrape type 2
2026-03-30 09:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 88e63003-a893-577a-aebd-a60df651d726, identifier: SB80667
2026-03-30 09:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 88e63003-a893-577a-aebd-a60df651d726 with identifier: SB80667
2026-03-30 09:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 88e63003-a893-577a-aebd-a60df651d726 with identifier: SB80667
2026-03-30 09:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 88e63003-a893-577a-aebd-a60df651d726 with identifier: SB80667 to the API
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:50Z',
 'fuel_type': 'petrol',
 'id': '88e63003-a893-577a-aebd-a60df651d726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB80667',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'New Beetle',
 'odometer': 170422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-28',
 'seller_name': None,
 'title': 'Volkswagen New Beetle 1.8 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB80667%27 HTTP/1.1" 200 None
2026-03-30 09:10:45 [auto1.it] INFO: Saving data for SB80667: {'auction_closing_time': 1774885610.0, 'created_time': 1774688450.700195, 'last_price_update_time': 1774861845.638531}
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SB80667') HTTP/1.1" 204 0
2026-03-30 09:10:45 [auto1.it] INFO: Found listing with ID: HW51602
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW51602%27 HTTP/1.1" 200 None
2026-03-30 09:10:45 [auto1.it] INFO: Scrape type for HW51602: 2
2026-03-30 09:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a2c263-e989-5bc4-a2c9-e32a95466934 with identifier: HW51602
2026-03-30 09:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a2c263-e989-5bc4-a2c9-e32a95466934 with scrape type 2
2026-03-30 09:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40a2c263-e989-5bc4-a2c9-e32a95466934 with scrape type 2
2026-03-30 09:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 40a2c263-e989-5bc4-a2c9-e32a95466934, identifier: HW51602
2026-03-30 09:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 40a2c263-e989-5bc4-a2c9-e32a95466934 with identifier: HW51602
2026-03-30 09:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 40a2c263-e989-5bc4-a2c9-e32a95466934 with identifier: HW51602
2026-03-30 09:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 40a2c263-e989-5bc4-a2c9-e32a95466934 with identifier: HW51602 to the API
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:33:45Z',
 'fuel_type': 'petrol',
 'id': '40a2c263-e989-5bc4-a2c9-e32a95466934',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW51602',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 97190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-09',
 'seller_name': None,
 'title': 'Peugeot 206+ 1.1 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW51602%27 HTTP/1.1" 200 None
2026-03-30 09:10:46 [auto1.it] INFO: Saving data for HW51602: {'auction_closing_time': 1774884825.0, 'created_time': 1773131449.60831, 'last_price_update_time': 1774861846.766234}
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW51602') HTTP/1.1" 204 0
2026-03-30 09:10:46 [auto1.it] INFO: Found listing with ID: DX75497
2026-03-30 09:10:46 [auto1.it] INFO: Found listing with ID: KF97174
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF97174%27 HTTP/1.1" 200 None
2026-03-30 09:10:46 [auto1.it] INFO: Scrape type for KF97174: 2
2026-03-30 09:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 281d033e-4d3e-51ca-a99f-e830a319a8cc with identifier: KF97174
2026-03-30 09:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 281d033e-4d3e-51ca-a99f-e830a319a8cc with scrape type 2
2026-03-30 09:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 281d033e-4d3e-51ca-a99f-e830a319a8cc with scrape type 2
2026-03-30 09:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 281d033e-4d3e-51ca-a99f-e830a319a8cc, identifier: KF97174
2026-03-30 09:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 281d033e-4d3e-51ca-a99f-e830a319a8cc with identifier: KF97174
2026-03-30 09:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 281d033e-4d3e-51ca-a99f-e830a319a8cc with identifier: KF97174
2026-03-30 09:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 281d033e-4d3e-51ca-a99f-e830a319a8cc with identifier: KF97174 to the API
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:38:34Z',
 'fuel_type': 'diesel',
 'id': '281d033e-4d3e-51ca-a99f-e830a319a8cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF97174',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 186459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-08',
 'seller_name': None,
 'title': 'Opel Corsa 1.5 CDTI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2019}
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF97174%27 HTTP/1.1" 200 None
2026-03-30 09:10:47 [auto1.it] INFO: Saving data for KF97174: {'auction_closing_time': 1774885114.0, 'created_time': 1773132931.747749, 'last_price_update_time': 1774861847.712214}
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KF97174') HTTP/1.1" 204 0
2026-03-30 09:10:47 [auto1.it] INFO: Found listing with ID: UT33269
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT33269%27 HTTP/1.1" 200 None
2026-03-30 09:10:47 [auto1.it] INFO: Scrape type for UT33269: 2
2026-03-30 09:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dfa03af-68b3-5623-8343-d92ed9de464f with identifier: UT33269
2026-03-30 09:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dfa03af-68b3-5623-8343-d92ed9de464f with scrape type 2
2026-03-30 09:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dfa03af-68b3-5623-8343-d92ed9de464f with scrape type 2
2026-03-30 09:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3dfa03af-68b3-5623-8343-d92ed9de464f, identifier: UT33269
2026-03-30 09:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3dfa03af-68b3-5623-8343-d92ed9de464f with identifier: UT33269
2026-03-30 09:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3dfa03af-68b3-5623-8343-d92ed9de464f with identifier: UT33269
2026-03-30 09:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3dfa03af-68b3-5623-8343-d92ed9de464f with identifier: UT33269 to the API
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:37:12Z',
 'fuel_type': 'diesel',
 'id': '3dfa03af-68b3-5623-8343-d92ed9de464f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT33269',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 122669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-18',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT33269%27 HTTP/1.1" 200 None
2026-03-30 09:10:48 [auto1.it] INFO: Saving data for UT33269: {'auction_closing_time': 1774885032.0, 'created_time': 1774688468.633041, 'last_price_update_time': 1774861848.259843}
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UT33269') HTTP/1.1" 204 0
2026-03-30 09:10:48 [auto1.it] INFO: Found listing with ID: GJ33186
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ33186%27 HTTP/1.1" 200 None
2026-03-30 09:10:48 [auto1.it] INFO: Scrape type for GJ33186: 2
2026-03-30 09:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5050bb6b-6380-5594-88f1-a5521d3a6102 with identifier: GJ33186
2026-03-30 09:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5050bb6b-6380-5594-88f1-a5521d3a6102 with scrape type 2
2026-03-30 09:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5050bb6b-6380-5594-88f1-a5521d3a6102 with scrape type 2
2026-03-30 09:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5050bb6b-6380-5594-88f1-a5521d3a6102, identifier: GJ33186
2026-03-30 09:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5050bb6b-6380-5594-88f1-a5521d3a6102 with identifier: GJ33186
2026-03-30 09:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5050bb6b-6380-5594-88f1-a5521d3a6102 with identifier: GJ33186
2026-03-30 09:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5050bb6b-6380-5594-88f1-a5521d3a6102 with identifier: GJ33186 to the API
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:32:05Z',
 'fuel_type': 'petrol',
 'id': '5050bb6b-6380-5594-88f1-a5521d3a6102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ33186',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 80842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-06',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2010}
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ33186%27 HTTP/1.1" 200 None
2026-03-30 09:10:49 [auto1.it] INFO: Saving data for GJ33186: {'auction_closing_time': 1774884725.0, 'created_time': 1774688452.677512, 'last_price_update_time': 1774861849.253092}
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GJ33186') HTTP/1.1" 204 0
2026-03-30 09:10:49 [auto1.it] INFO: Found listing with ID: CJ50775
2026-03-30 09:10:49 [auto1.it] INFO: Found listing with ID: YB09690
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB09690%27 HTTP/1.1" 200 None
2026-03-30 09:10:49 [auto1.it] INFO: Scrape type for YB09690: 2
2026-03-30 09:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa394b43-4395-5682-9888-3f1841eb488e with identifier: YB09690
2026-03-30 09:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa394b43-4395-5682-9888-3f1841eb488e with scrape type 2
2026-03-30 09:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa394b43-4395-5682-9888-3f1841eb488e with scrape type 2
2026-03-30 09:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa394b43-4395-5682-9888-3f1841eb488e, identifier: YB09690
2026-03-30 09:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa394b43-4395-5682-9888-3f1841eb488e with identifier: YB09690
2026-03-30 09:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa394b43-4395-5682-9888-3f1841eb488e with identifier: YB09690
2026-03-30 09:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa394b43-4395-5682-9888-3f1841eb488e with identifier: YB09690 to the API
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:55:09Z',
 'fuel_type': 'petrol',
 'id': 'fa394b43-4395-5682-9888-3f1841eb488e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB09690',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 138134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-26',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo City Cross',
 'transmission': 'manual',
 'trim': 'City Cross',
 'year': 2019}
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB09690%27 HTTP/1.1" 200 None
2026-03-30 09:10:50 [auto1.it] INFO: Saving data for YB09690: {'auction_closing_time': 1774886109.0, 'created_time': 1774688446.595289, 'last_price_update_time': 1774861850.146912}
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YB09690') HTTP/1.1" 204 0
2026-03-30 09:10:50 [auto1.it] INFO: Channel: 24h | Page: 84 | totalHits: 3310 | hits on page: 0
2026-03-30 09:10:50 [auto1.it] INFO: Found listing with ID: UC99700
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC99700%27 HTTP/1.1" 200 None
2026-03-30 09:10:50 [auto1.it] INFO: Scrape type for UC99700: 2
2026-03-30 09:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04649e58-e4e7-5901-8ebe-129b7367272c with identifier: UC99700
2026-03-30 09:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04649e58-e4e7-5901-8ebe-129b7367272c with scrape type 2
2026-03-30 09:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04649e58-e4e7-5901-8ebe-129b7367272c with scrape type 2
2026-03-30 09:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 04649e58-e4e7-5901-8ebe-129b7367272c, identifier: UC99700
2026-03-30 09:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 04649e58-e4e7-5901-8ebe-129b7367272c with identifier: UC99700
2026-03-30 09:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 04649e58-e4e7-5901-8ebe-129b7367272c with identifier: UC99700
2026-03-30 09:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 04649e58-e4e7-5901-8ebe-129b7367272c with identifier: UC99700 to the API
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:31:51Z',
 'fuel_type': 'diesel',
 'id': '04649e58-e4e7-5901-8ebe-129b7367272c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC99700',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 201343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-30',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2009}
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC99700%27 HTTP/1.1" 200 None
2026-03-30 09:10:50 [auto1.it] INFO: Saving data for UC99700: {'auction_closing_time': 1774884711.0, 'created_time': 1773954771.982805, 'last_price_update_time': 1774861850.558352}
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UC99700') HTTP/1.1" 204 0
2026-03-30 09:10:50 [auto1.it] INFO: Found listing with ID: EG31110
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG31110%27 HTTP/1.1" 200 None
2026-03-30 09:10:50 [auto1.it] INFO: Scrape type for EG31110: 2
2026-03-30 09:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8378a5eb-70c7-5357-a7eb-5ef2700fd036 with identifier: EG31110
2026-03-30 09:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8378a5eb-70c7-5357-a7eb-5ef2700fd036 with scrape type 2
2026-03-30 09:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8378a5eb-70c7-5357-a7eb-5ef2700fd036 with scrape type 2
2026-03-30 09:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8378a5eb-70c7-5357-a7eb-5ef2700fd036, identifier: EG31110
2026-03-30 09:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8378a5eb-70c7-5357-a7eb-5ef2700fd036 with identifier: EG31110
2026-03-30 09:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8378a5eb-70c7-5357-a7eb-5ef2700fd036 with identifier: EG31110
2026-03-30 09:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8378a5eb-70c7-5357-a7eb-5ef2700fd036 with identifier: EG31110 to the API
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:39:29Z',
 'fuel_type': 'diesel',
 'id': '8378a5eb-70c7-5357-a7eb-5ef2700fd036',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG31110',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 133145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG31110%27 HTTP/1.1" 200 None
2026-03-30 09:10:50 [auto1.it] INFO: Saving data for EG31110: {'auction_closing_time': 1774885169.0, 'created_time': 1774688446.977273, 'last_price_update_time': 1774861850.982627}
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EG31110') HTTP/1.1" 204 0
2026-03-30 09:10:51 [auto1.it] INFO: Found listing with ID: SK62476
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK62476%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [auto1.it] INFO: Scrape type for SK62476: 2
2026-03-30 09:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 891143cb-01ba-58ee-8700-07bc95cbce58 with identifier: SK62476
2026-03-30 09:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 891143cb-01ba-58ee-8700-07bc95cbce58 with scrape type 2
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 891143cb-01ba-58ee-8700-07bc95cbce58 with scrape type 2
2026-03-30 09:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 891143cb-01ba-58ee-8700-07bc95cbce58, identifier: SK62476
2026-03-30 09:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 891143cb-01ba-58ee-8700-07bc95cbce58 with identifier: SK62476
2026-03-30 09:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 891143cb-01ba-58ee-8700-07bc95cbce58 with identifier: SK62476
2026-03-30 09:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 891143cb-01ba-58ee-8700-07bc95cbce58 with identifier: SK62476 to the API
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:21:30Z',
 'fuel_type': 'diesel',
 'id': '891143cb-01ba-58ee-8700-07bc95cbce58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK62476',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 69359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-12',
 'seller_name': None,
 'title': 'Land Rover Evoque D180 Mild-Hybrid R-dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-dynamic SE',
 'year': 2020}
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK62476%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [auto1.it] INFO: Saving data for SK62476: {'auction_closing_time': 1774884090.0, 'created_time': 1774688467.081957, 'last_price_update_time': 1774861851.38309}
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK62476') HTTP/1.1" 204 0
2026-03-30 09:10:51 [auto1.it] INFO: Found listing with ID: KR24813
2026-03-30 09:10:51 [auto1.it] INFO: Found listing with ID: WL53741
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL53741%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [auto1.it] INFO: Scrape type for WL53741: 2
2026-03-30 09:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2015853c-9978-555b-9f1e-1d07a5343122 with identifier: WL53741
2026-03-30 09:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2015853c-9978-555b-9f1e-1d07a5343122 with scrape type 2
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2015853c-9978-555b-9f1e-1d07a5343122 with scrape type 2
2026-03-30 09:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2015853c-9978-555b-9f1e-1d07a5343122, identifier: WL53741
2026-03-30 09:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2015853c-9978-555b-9f1e-1d07a5343122 with identifier: WL53741
2026-03-30 09:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2015853c-9978-555b-9f1e-1d07a5343122 with identifier: WL53741
2026-03-30 09:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2015853c-9978-555b-9f1e-1d07a5343122 with identifier: WL53741 to the API
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:35Z',
 'fuel_type': 'diesel',
 'id': '2015853c-9978-555b-9f1e-1d07a5343122',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL53741',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 201246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-24',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2015}
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL53741%27 HTTP/1.1" 200 None
2026-03-30 09:10:52 [auto1.it] INFO: Saving data for WL53741: {'auction_closing_time': 1774883195.0, 'created_time': 1774688464.337166, 'last_price_update_time': 1774861852.215319}
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WL53741') HTTP/1.1" 204 0
2026-03-30 09:10:52 [auto1.it] INFO: Found listing with ID: KK99486
2026-03-30 09:10:52 [auto1.it] INFO: Found listing with ID: XW14976
2026-03-30 09:10:52 [auto1.it] INFO: Found listing with ID: CV32353
2026-03-30 09:10:52 [auto1.it] INFO: Found listing with ID: YE49798
2026-03-30 09:10:52 [auto1.it] INFO: Found listing with ID: RB84694
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB84694%27 HTTP/1.1" 200 None
2026-03-30 09:10:52 [auto1.it] INFO: Scrape type for RB84694: 2
2026-03-30 09:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c7a7acf-98b8-543a-bafa-a4d168e82eb0 with identifier: RB84694
2026-03-30 09:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7a7acf-98b8-543a-bafa-a4d168e82eb0 with scrape type 2
2026-03-30 09:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c7a7acf-98b8-543a-bafa-a4d168e82eb0 with scrape type 2
2026-03-30 09:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c7a7acf-98b8-543a-bafa-a4d168e82eb0, identifier: RB84694
2026-03-30 09:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c7a7acf-98b8-543a-bafa-a4d168e82eb0 with identifier: RB84694
2026-03-30 09:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c7a7acf-98b8-543a-bafa-a4d168e82eb0 with identifier: RB84694
2026-03-30 09:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c7a7acf-98b8-543a-bafa-a4d168e82eb0 with identifier: RB84694 to the API
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:32:34Z',
 'fuel_type': 'petrol',
 'id': '8c7a7acf-98b8-543a-bafa-a4d168e82eb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB84694',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 51772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB84694%27 HTTP/1.1" 200 None
2026-03-30 09:10:52 [auto1.it] INFO: Saving data for RB84694: {'auction_closing_time': 1774884754.0, 'created_time': 1773954599.135732, 'last_price_update_time': 1774861852.614056}
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RB84694') HTTP/1.1" 204 0
2026-03-30 09:10:52 [auto1.it] INFO: Found listing with ID: DJ31826
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ31826%27 HTTP/1.1" 200 None
2026-03-30 09:10:52 [auto1.it] INFO: Scrape type for DJ31826: 2
2026-03-30 09:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fba7d46d-84d7-558f-9097-bf737e569eca with identifier: DJ31826
2026-03-30 09:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fba7d46d-84d7-558f-9097-bf737e569eca with scrape type 2
2026-03-30 09:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fba7d46d-84d7-558f-9097-bf737e569eca with scrape type 2
2026-03-30 09:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fba7d46d-84d7-558f-9097-bf737e569eca, identifier: DJ31826
2026-03-30 09:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fba7d46d-84d7-558f-9097-bf737e569eca with identifier: DJ31826
2026-03-30 09:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fba7d46d-84d7-558f-9097-bf737e569eca with identifier: DJ31826
2026-03-30 09:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fba7d46d-84d7-558f-9097-bf737e569eca with identifier: DJ31826 to the API
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:45:38Z',
 'fuel_type': 'diesel',
 'id': 'fba7d46d-84d7-558f-9097-bf737e569eca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ31826',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 178025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-11',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D ALL4',
 'transmission': 'manual',
 'trim': 'ALL4',
 'year': 2011}
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ31826%27 HTTP/1.1" 200 None
2026-03-30 09:10:53 [auto1.it] INFO: Saving data for DJ31826: {'auction_closing_time': 1774885538.0, 'created_time': 1774688447.781092, 'last_price_update_time': 1774861853.036118}
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DJ31826') HTTP/1.1" 204 0
2026-03-30 09:10:53 [auto1.it] INFO: Found listing with ID: UL30423
2026-03-30 09:10:53 [auto1.it] INFO: Found listing with ID: MT45417
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT45417%27 HTTP/1.1" 200 None
2026-03-30 09:10:53 [auto1.it] INFO: Scrape type for MT45417: 2
2026-03-30 09:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d10eb72b-e95d-562e-9bb3-9568ada2d821 with identifier: MT45417
2026-03-30 09:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d10eb72b-e95d-562e-9bb3-9568ada2d821 with scrape type 2
2026-03-30 09:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d10eb72b-e95d-562e-9bb3-9568ada2d821 with scrape type 2
2026-03-30 09:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d10eb72b-e95d-562e-9bb3-9568ada2d821, identifier: MT45417
2026-03-30 09:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d10eb72b-e95d-562e-9bb3-9568ada2d821 with identifier: MT45417
2026-03-30 09:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d10eb72b-e95d-562e-9bb3-9568ada2d821 with identifier: MT45417
2026-03-30 09:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d10eb72b-e95d-562e-9bb3-9568ada2d821 with identifier: MT45417 to the API
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:01Z',
 'fuel_type': 'diesel',
 'id': 'd10eb72b-e95d-562e-9bb3-9568ada2d821',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT45417',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 147278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-20',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2017}
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT45417%27 HTTP/1.1" 200 None
2026-03-30 09:10:53 [auto1.it] INFO: Saving data for MT45417: {'auction_closing_time': 1774884181.0, 'created_time': 1774688454.65059, 'last_price_update_time': 1774861853.482302}
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MT45417') HTTP/1.1" 204 0
2026-03-30 09:10:53 [auto1.it] INFO: Found listing with ID: FV07755
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV07755%27 HTTP/1.1" 200 None
2026-03-30 09:10:53 [auto1.it] INFO: Scrape type for FV07755: 2
2026-03-30 09:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e5496d-79bd-5b57-a590-4dd9104d03de with identifier: FV07755
2026-03-30 09:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e5496d-79bd-5b57-a590-4dd9104d03de with scrape type 2
2026-03-30 09:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55e5496d-79bd-5b57-a590-4dd9104d03de with scrape type 2
2026-03-30 09:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 55e5496d-79bd-5b57-a590-4dd9104d03de, identifier: FV07755
2026-03-30 09:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 55e5496d-79bd-5b57-a590-4dd9104d03de with identifier: FV07755
2026-03-30 09:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 55e5496d-79bd-5b57-a590-4dd9104d03de with identifier: FV07755
2026-03-30 09:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 55e5496d-79bd-5b57-a590-4dd9104d03de with identifier: FV07755 to the API
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:58:16Z',
 'fuel_type': 'petrol',
 'id': '55e5496d-79bd-5b57-a590-4dd9104d03de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV07755',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 74903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-04',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Now',
 'transmission': 'manual',
 'trim': 'Now',
 'year': 2010}
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV07755%27 HTTP/1.1" 200 None
2026-03-30 09:10:53 [auto1.it] INFO: Saving data for FV07755: {'auction_closing_time': 1774886296.0, 'created_time': 1774688461.736279, 'last_price_update_time': 1774861853.941559}
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FV07755') HTTP/1.1" 204 0
2026-03-30 09:10:54 [auto1.it] INFO: Found listing with ID: SW75734
2026-03-30 09:10:54 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 09:10:54 [auto1.it] INFO: auto1.it Batch config: batch 1/2
2026-03-30 09:10:54 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 1}
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20last_price_update_time%20lt%201774429854 HTTP/1.1" 200 None
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AG25279') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AG97649') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AH00208') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AN81141') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AP41733') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AW68080') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='AW71418') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BE12115') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BH37270') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BK02293') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BU05811') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BU91688') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BV90232') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CB92273') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CE82002') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CH14661') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CK37243') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CM86033') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CY04266') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CY73281') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DE27893') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DP37147') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DV40234') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='EJ81715') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='EW20202') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='FP65052') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='FS19770') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='FY15726') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='GB45661') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='GH67752') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='GN34004') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='GS93804') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='GX72888') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HJ90842') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HP51717') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HP97831') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JB82160') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JC89041') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JK94703') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JM09628') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JM14633') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JS07977') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JS31192') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JS36532') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JT79745') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JV86394') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JW16641') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KB79560') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KP70766') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KU14130') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KZ62805') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KZ64473') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LF37597') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LK94217') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LU07392') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LW91242') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LX64468') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LX81628') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MH12766') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MS03191') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MS57491') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MW56052') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NE64125') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NH61683') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NH85847') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NJ51332') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NJ72265') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NJ80675') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NW82819') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PM83335') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PP26655') HTTP/1.1" 204 0
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PS86291') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ68528') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RH42568') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RS38153') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RU08274') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RU89176') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RX25946') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SH44884') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SP62866') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SY09858') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TE05124') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TL29149') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TW71862') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TW92187') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UD63825') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UH35590') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UR03229') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UT41339') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UV11436') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UZ83014') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VR47392') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VR91781') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VU37095') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VZ44910') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WD26955') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WE40529') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XE88464') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XH41189') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XK39562') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XL14725') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XN69050') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XS32220') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XW35683') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YB55288') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YD67183') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YK81218') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YT45084') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YV19544') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YW16369') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YX87709') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YY64225') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZF67691') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZK44136') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZR68387') HTTP/1.1" 204 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZV07426') HTTP/1.1" 204 0
2026-03-30 09:10:55 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (783 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_24_2026-03-30T09_00_00.jl
2026-03-30 09:10:55 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1597894,
 'downloader/request_count': 924,
 'downloader/request_method_count/GET': 838,
 'downloader/request_method_count/POST': 86,
 'downloader/response_bytes': 383566877,
 'downloader/response_count': 924,
 'downloader/response_status_count/200': 924,
 'dupefilter/filtered': 14,
 'elapsed_time_seconds': 651.48046,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 9, 10, 55, 514318, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 783,
 'log_count/DEBUG': 14912,
 'log_count/INFO': 16232,
 'memusage/max': 207974400,
 'memusage/startup': 150249472,
 'photo_download_count': 608,
 'request_depth_max': 87,
 'response_received_count': 316,
 'scheduler/dequeued': 924,
 'scheduler/dequeued/memory': 924,
 'scheduler/enqueued': 924,
 'scheduler/enqueued/memory': 924,
 'scrape_type/batch_skipped': 1694,
 'scrape_type/new': 114,
 'scrape_type/price_update': 669,
 'scrape_type/skipped': 859,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 316,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 5.916828116693801,
 'scrapy-zyte-api/mean_response_seconds': 5.943442603303532,
 'scrapy-zyte-api/processed': 316,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 316,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 315,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 316,
 'scrapy-zyte-api/request_args/httpRequestBody': 86,
 'scrapy-zyte-api/request_args/httpRequestMethod': 86,
 'scrapy-zyte-api/request_args/httpResponseBody': 316,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 316,
 'scrapy-zyte-api/request_args/sessionContext': 316,
 'scrapy-zyte-api/request_args/url': 316,
 'scrapy-zyte-api/status_codes/200': 316,
 'scrapy-zyte-api/success': 316,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 3350,
 'source/total_available': 3310,
 'start_time': datetime.datetime(2026, 3, 30, 9, 0, 4, 33858, tzinfo=datetime.timezone.utc)}
2026-03-30 09:10:55 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 09:10:55 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f6e0d1339d0>
2026-03-30 09:10:55 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f6e0cdba990>